Analyst - Data Engineering
Core
Design, develop, and implement data pipelines and ETL processes on a Databricks-based data platform.
Role type
Data Engineer
Builds
Data platform built on Databricks services
Domain
Insurance / Risk Management / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Data modeling, Database design, ETL/ELT concepts, API integration, Data ingestion
Preferred skills
Assertive communication, Adaptability, Critical thinking, Sense of urgency, Analytical thinking, Proactivity
Technologies
Databricks
Responsibilities
Collaborate with stakeholders to translate data requirements into technical specifications; Design, develop, and implement data pipelines and ETL processes; Implement data quality checks and validation processes; Coordinate with cross-functional teams; Monitor data workflows for performance and reliability; Create and maintain documentation for data processes and architecture.
Seniority
Mid-level (3-5 years experience)