Data Engineer
Core
Build and evolve an established Azure Databricks data platform, translating business requirements into sustainable data products and pipelines.
Role type
Senior Data Engineer (Azure Databricks)
Builds
ETL pipelines, data models (gold warehouse), and data products for business units
Domain
Cloud data engineering (Azure Databricks, PySpark, SQL)
Deliverable
production ML models | product features
Required skills
Azure Databricks, PySpark, Spark SQL, Data Modeling (Kimball), CI/CD (YAML pipelines), Unit & Integration Testing, Data Governance, Performance Tuning
Preferred skills
ServiceNow incident management, Architecture documentation
Technologies
Azure Databricks, PySpark, SQL, Azure DevOps, ServiceNow
Responsibilities
Build and maintain ETL pipelines using PySpark and SQL; Model data in gold warehouses; Set up and improve CI/CD flows; Ensure data cleansing and access control; Monitor and resolve performance incidents; Document architecture and data models
Seniority
Senior, hands-on IC

