Data & Analytics - Data Engineer (all genders)
Core
Design, build, and operate reliable data pipelines and products using Databricks and Azure Data Factory to support data scientists, analysts, and product owners.
Role type
Senior Data Engineer (Data & Analytics)
Builds
Production data pipelines, data products, and optimized data systems
Domain
Insurance / Data Engineering
Deliverable
production ML models
Required skills
Databricks (Python, Spark SQL, Lakehouse), Azure Data Factory, SQL/NoSQL data modeling, pipeline orchestration, performance tuning, DataOps practices (versioning, testing, automated deployments, observability)
Preferred skills
Declarative Pipelines, reusable template creation, documentation
Technologies
Databricks, Python, Spark SQL, Lakeflow, Azure Data Factory, SQL, NoSQL
Responsibilities
Collaborate with data scientists and product owners to build pipelines; Design and operate Databricks pipelines; Integrate and optimize databases; Ensure pipeline quality via testing and monitoring; Manage platform costs and performance; Establish group-wide standards and documentation
Seniority
Experienced, hands-on IC