hero

Left Lane Portfolio Jobs

67
companies
602
Jobs

Data Engineer (POEN)

Fetcherr

Fetcherr

Data Science
Poland
Posted on Jul 2, 2024

Data Engineer (POEN)

  • AI
  • Israel
  • Full-time

Description

Data Engineer (POEN)

We're looking for a Data Engineer to help us grow our data engineering capabilities. The ideal candidate is a python engineer with a solid background in building data-intensive applications, familiar with industrial best practices who is self-driven, motivated, independent, and sharp.

You as a member of the data engineering team will take an active part in all development phases, including research, design, development, testing and deployment using technologies like Python, Dagster, Kubernetes, BigQuery, Clickhouse, Ray.

Requirements

You’ll be a great fit if you have:

  • Strong Python programming skills, including:
  • 3+ years of production experience
  • Working with highly parallel computations
  • Optimizing memory consumption
  • Optimizing IO operations at scale
  • Fluency in SQL and data modeling within both OLAP and OLTP databases
  • Vast experience in building ETL(ELT) pipelines with diverse architectures (streaming, batching) using any orchestration tools (i.e. Dagster, Airflow, Prefect, Luigi, etc.)
  • Fluent with commonly used data engineering libraries like pandas, pyarrow, numpy, Jinja, dbt
  • Hands-on experience in containerized environments (Docker, Kubernetes, Podman, etc.)
  • B.Sc or Master’s degree in Computer Science or equivalent STEM degree
  • You’re a team player, ready to help others
  • Have a readiness and willingness to continuously learn while working
  • Readiness to work in stressful environment with strict deadlines and SLA’s

Would be an extra-plus if you have:

  • Strong experience with Dagster
  • Practical experience with functional programming. Any language, conceptual knowledge is more important
  • Familiarity with cloud computing (ideally GCP)
  • Test-driven development mindset
  • Experience with CI/CD tooling i.e. GitlabCI, Github Actions, etc.