Senior Data Engineer
Core
Design, build, and maintain Silver and Gold table transformations within an Azure Databricks lakehouse, creating data products for business consumption including underwriters and actuaries.
Role type
Senior Data Engineer (Insurance)
Builds
Data products, Silver and Gold table transformations, and Power BI dashboards
Domain
Insurance / Data Engineering
Deliverable
production ML models
Required skills
Advanced SQL, PySpark, Data modelling (medallion architecture), Azure Databricks, Delta Lake, Power BI
Preferred skills
Unity Catalog, semantic layer tooling, Databricks Dashboards, LLMs, AI, RAG, Databricks Genie
Technologies
Azure Databricks, Delta Lake, Power BI, SQL, PySpark
Responsibilities
Design and maintain Silver and Gold table transformations; Contribute technical input into data modelling discussions; Investigate and resolve data quality issues; Build new data products and Power BI dashboards; Collaborate with business stakeholders to translate requirements into robust data products; Support code and modelling reviews
Seniority
Senior, hands-on IC