Data Engineer (Databricks)
Core
Lead the design and build of scalable data pipelines to validate and transform policyholder data for actuarial modelling and assumption setting.
Role type
Manager/Expert level Data Engineer
Builds
Robust, reliable, and efficient data systems for actuarial modelling
Domain
Financial Services / Actuarial Modelling
Deliverable
production ML models | infrastructure
Required skills
Data pipeline development, Data modelling and architecture, Programming and scripting, Data governance, Stakeholder engagement, Continuous improvement
Preferred skills
People management, UK Financial Services experience, Life Insurance experience
Technologies
Azure Databricks, Spark, Spark SQL, Python, PySpark
Responsibilities
Lead design and build of scalable data pipelines, Ensure data quality and integrity through validation and monitoring, Optimise data systems for performance and scalability, Provide technical expertise and guidance on data engineering approaches, Lead the work of other data engineers and analysts, Contribute to continuous improvement of data platforms and engineering standards
Seniority
Manager or Expert level, hands-on IC with people management responsibilities