Data Engineer
Core
Design, build, and optimize data pipelines and infrastructure to move, process, and store data for data-driven organizations.
Role type
Data Engineer
Builds
Data warehouses, data lakes, distributed data meshes, and scalable data applications
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models
Required skills
Data pipeline design, data modeling, cloud data platforms, infrastructure management, Python, open-source technologies (Spark, Kafka, Airflow, Kubernetes)
Preferred skills
Experience with batch and near-real-time data processing, distributed systems
Technologies
Spark, Kafka, Airflow, Kubernetes, Python
Responsibilities
Design and build data pipelines, productionize machine learning models, deploy and configure data infrastructure, create insights and make data available for data teams
Seniority
Mid-level (2-4 years experience)