Senior Data Engineer
Core
Design, develop, and maintain scalable data pipelines and platforms using Databricks and Microsoft Azure to support business intelligence, analytics, and operational workloads.
Role type
Senior IC data engineer
Builds
Robust data pipelines, ETL/ELT workflows, and scalable data solutions
Domain
Data engineering, cloud data platforms
Deliverable
production ML models
Required skills
Databricks, Microsoft Azure, Apache Spark (PySpark), ETL/ELT design, SQL, data modeling, distributed data processing
Preferred skills
Delta Lake, Lakehouse architectures, data governance, data quality monitoring
Technologies
Databricks, Microsoft Azure, Apache Spark, PySpark, SQL
Responsibilities
Design and develop scalable data pipelines; Build and optimize ETL/ELT workflows; Develop and optimize Apache Spark jobs; Ensure data quality, consistency, and reliability; Troubleshoot data pipeline and Spark job issues; Create and maintain technical documentation
Seniority
Senior, hands-on IC