Data Engineer
Core
Ingest large volumes of data, analyze it with Data Scientists, and design/optimize large-scale data pipelines in cloud and on-premise environments.
Role type
Senior Data Engineer
Builds
Large-scale data pipelines and processes for core DWH and AI projects
Domain
Cloud data engineering, AI/ML data infrastructure
Deliverable
production ML models
Required skills
Python (OOP), Spark, dbt, Airflow/Kubeflow, Docker/Kubernetes, Parquet/Iceberg/Avro/HDF5/Delta Lake, AWS data services, BI tools integration, ML concepts, GenAI/prompt engineering
Preferred skills
None explicitly stated as preferred (listed as advantages)
Technologies
AWS (Athena, Glue, EMR, Redshift, RDS), Spark, dbt, Airflow, Kubeflow, Docker, Kubernetes, QuickSight, Tableau, PowerBI
Responsibilities
Ingest large volumes of new data; Conduct deep data analysis in collaboration with Data Scientists; Design and develop critical, diverse, and large-scale data pipelines; Deploy and optimize data solutions across cloud and on-premise environments
Seniority
Mid-to-Senior (3+ years experience)
