Data engineer

We are looking for a Data Engineer to work on a variety of data projects in a small, fully remote company. If you are passionate about machine learning this is the place for you!

Prophecy Labs is a Data Project House with an HQ in Belgium. We are a team of passionate Data Scientists, Data Engineers and Software Engineers from around the globe. We do end-to-end projects in the Data Science field focusing on challenging problems that provide value.

Responsibilities

  • Building, maintaining, scaling, automating, and improving data pipelines related features on our products.
  • Enhancing ETL and data science pipelines to work in a fully automated way.
  • Work together with data scientists and developers to automate and put in production data science use-cases.
  • Working on cutting edge solutions for a variety of projects.

Job Requirements

  • Proficiency in English - absolutely mandatory, we’re an English speaking team.
  • Write clean, tested and well documented code.
  • Experience with working in a production data environment.
  • Experience with CDI/Orchestration/Scheduling/ETL/Version control software such as Jenkins/Ansible/Airflow/Nifi/Git/Bitbucket is a plus.
  • Knowledge of optimization of ML models to work at scale.
  • Experience the end to end big data process.
  • Experience with GCP/AWS.
  • Experience with python data science stack (pandas, scikit learn, keras, numpy, tensorflow).
  • Experience with machine learning is a plus.
  • Masters degree in computer science or other related field (physics, mathematics, engineering, and bioinformatics)..
  • 1-3 years working as a data engineer or related field.