Azure Data Engineer
Core
Design and deliver scalable data pipelines, Lakehouse solutions, and governed data platforms on Azure to support enterprise analytics and business decision-making.
Role type
Senior IC Azure Databricks Data Engineer
Builds
Scalable ETL/ELT pipelines, Lakehouse architectures (Delta Lake), and governed data platforms
Domain
Finance and Insurance / Cloud Data Engineering
Required skills
PySpark, SQL, Delta Lake, Unity Catalog, Power BI, Azure Databricks, Git, Azure DevOps, CI/CD, Data Governance, Role-based access control, Data modeling
Preferred skills
AI/ML pipeline deployment, Finance and Insurance business processes knowledge
Technologies
Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Power BI, Git, Azure DevOps, GitHub
Responsibilities
Develop and implement scalable data integration pipelines on Azure Databricks; Build and maintain Lakehouse architectures using Delta Lake and bronze, silver, and gold data layers; Implement and manage Unity Catalog for centralized governance; Define and enforce role-based access control and auditing; Deliver performance-optimized datasets for Power BI; Collaborate with BI developers on semantic models and data contracts; Optimize Databricks clusters and job schedules; Contribute to CI/CD pipelines for Databricks code.
Seniority
Senior, hands-on IC with technical leadership