Data engineer
Hybrid
Core
Build and maintain data pipelines, transform diverse data formats into usable information, and ensure data quality and integrity for the Life&Pensions Data Platform.
Role type
Data engineer
Builds
Data pipelines and transformed data for the Life&Pensions Data Platform
Domain
Insurance / Data engineering
Deliverable
production ML models
Required skills
Azure, Python, PySpark, SQL, Azure Data Factory, Azure Databricks, data pipeline development, data quality frameworks
Preferred skills
Azure DevOps, CI/CD, software engineering best practices
Technologies
Azure, Azure Data Factory, Azure Databricks, Azure DevOps, Git, Python, PySpark, SQL
Responsibilities
Implement and improve data pipelines, transform data formats, collaborate with DataOps engineers for automation, configure quality control frameworks
Seniority
Mid-level, hands-on IC
