Data Engineer
Core
Design, build, test, and maintain scalable ELT data pipelines and medallion architecture data models on Azure Databricks to support enterprise reporting and Power BI dashboards.
Role type
Senior IC Data Engineer (Azure Databricks)
Builds
Production data pipelines, silver/gold layer datasets, and Power BI reporting infrastructure
Domain
Media intelligence, data solutions, enterprise analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, SQL, Databricks (Unity Catalog, DABs, DLT), Azure ADLS Gen2, CI/CD, DevOps, data modeling, API integrations
Preferred skills
AI & ML technologies
Technologies
Azure Databricks, Delta Live Tables, Databricks Asset Bundles, PySpark, SQL, GitHub Actions, Power BI, Azure ADLS Gen2, Azure Key Vault, Azure SQL
Responsibilities
Design and deliver silver/gold layer data models within the medallion architecture; Implement secure platforms with Unity Catalog access controls and data lineage; Execute data migrations and develop integrations via APIs; Maintain documentation of pipelines and technical logic; Manage data workflows and orchestration for ELT processes.
Seniority
Senior, hands-on IC
