Data Engineer
Core
Design, build, and maintain reliable data pipelines and scalable data solutions that power analytics and business decision-making.
Role type
Data Engineer
Builds
Production-grade data infrastructure, batch and streaming pipelines, and analytical data models
Domain
Cloud data engineering
Deliverable
production ML models
Required skills
SQL, Python, Azure, Databricks, data modeling, pipeline orchestration, data quality controls, Git, Kubernetes
Preferred skills
Apache Airflow, Azure Data Factory, Kafka, Azure Event Hubs, data observability, Java Spring Boot
Technologies
SQL, Python, Azure, Databricks, Parquet, ORC, Kubernetes, Git
Responsibilities
Design and develop end-to-end batch and streaming data pipelines; Build and operate ETL/ELT workflows; Write efficient SQL queries for data extraction and analytics; Design and maintain analytical data models; Develop reusable Python code for data transformations; Monitor pipeline performance and troubleshoot failures; Implement automated data quality controls; Translate business requirements into technical data solutions; Collaborate with analysts and engineers to define data contracts; Create and maintain technical documentation.
Seniority
Junior to Senior