Data Engineer
Core
Design, build, and maintain scalable data pipelines, analytics infrastructure, and database schemas to support operational efficiencies and reproducible machine learning workflows.
Role type
Senior Data Engineer (Azure & Spark)
Builds
Production data pipelines, analytics platforms, and optimized database schemas
Domain
Enterprise data engineering, cloud data platforms, and analytics infrastructure
Deliverable
production ML models
Required skills
Azure Data Factory, Apache Spark (PySpark/SQL), Kubernetes, Power BI semantic modeling, database architecture, data governance, data transformation, ETL/ELT orchestration
Preferred skills
Microsoft Fabric, advanced analytics platform design, root-cause investigation, stakeholder engagement
Technologies
Azure Data Factory, Apache Spark, Kubernetes, Power BI, Microsoft Fabric
Responsibilities
Develop and maintain data architecture and infrastructure; Build and monitor Azure Data Factory pipelines; Develop and troubleshoot Apache Spark workloads in Kubernetes; Design and optimize Power BI semantic models; Support advanced analytics platforms for ML workflows; Design scalable database schemas and optimize queries; Apply data governance standards for metadata and lineage management.
Seniority
Senior, hands-on IC