Senior Data Engineer
Core
Design, build, and maintain scalable data pipelines and business-ready datasets on Azure Databricks and Azure Data Factory to support operational, financial, and analytical reporting.
Role type
Senior IC data engineer (cloud data platform)
Builds
Production-grade ETL/ELT pipelines, curated data layers, and analytics-ready datasets
Domain
Insurance industry + cloud data engineering (Azure/Databricks)
Deliverable
production ML models | product features
Required skills
PySpark, SQL, Azure Databricks, Azure Data Factory, Delta Lake, Unity Catalog, CI/CD pipeline ownership, data quality validation, performance tuning
Preferred skills
Insurance domain knowledge, AI/automation in data workflows, Power BI
Technologies
Azure Databricks, Azure Data Factory, Delta Lake, Unity Catalog, Azure DevOps, Power BI, PySpark, SQL
Responsibilities
Design and maintain data transformation logic and ETL/ELT pipelines; implement data governance and security controls via Unity Catalog; conduct data profiling and validation; optimize platform performance and cost; manage CI/CD processes; serve curated datasets for reporting.
Seniority
Senior, hands-on IC