Data Engineer
Core
Design, build, and maintain production ETL pipelines and analytical solutions for predictive modeling workloads, powering insurance products and business partners.
Role type
mid-level data engineer
Builds
production-ready datasets consumed by data scientists and decision-makers
Domain
Insurance / Financial Services
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark / PySpark, Databricks, Azure data services, SQL Server, Synapse Analytics, Snowflake
Preferred skills
CLI tools, Git, workflow orchestration, CI/CD
Technologies
PySpark, Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, SQL Server, Snowflake
Responsibilities
Design and optimize PySpark jobs on Databricks; write complex SQL for data transformation and reporting; monitor pipeline health and troubleshoot failures; document data flows and schemas; present architecture decisions to stakeholders.
Seniority
Mid-level, hands-on IC