Data Engineer (DBX,dbt), Regular
Core
Building a Central Data Platform for a global insurance company, focusing on end-to-end data pipelines, training datasets for ML, and data consumption.
Role type
Data Engineer (ETL/ELT specialist)
Builds
End-to-end data pipelines (ingestion, transformation, storage, consumption) and training datasets for machine learning models
Domain
Insurance / Cloud Data Engineering
Deliverable
production ML models
Required skills
Databricks (DBX), Python, PySpark, SQL, ETL/ELT pipeline design, Azure Data Services, CI/CD practices
Preferred skills
dbt, Pydantic/PydanticAI, Ontology preparation, Insurance domain experience
Technologies
Databricks, dbt, dltHub, PowerBI, GitHub, Terraform, Azure Cloud
Responsibilities
Design and implement end-to-end data pipelines; Prepare and maintain high-quality training datasets for ML models; Ensure optimal and technically integral ETLs; Work with large-scale data on a modern cloud data platform; Apply best practices in data engineering, testing, and deployment; Collaborate with data scientists, engineers, and business stakeholders; Continuously improve performance, reliability, and automation of data workflows