Analyst - Data Engineering
Core
Design, develop, and implement data pipelines and ETL/ELT processes on a Databricks-based data platform across different regions.
Role type
Senior Data Engineer
Builds
Data pipelines, ETL/ELT processes, and data platform infrastructure
Domain
Insurance / Risk Management / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Data Modeling, Database Design, ETL/ELT, API Integration, Data Ingestion, Data Testing, Apache Spark, Cloud Platforms (AWS/Azure), Databricks, Snowflake
Preferred skills
AI Integration, QA Engineering Management, SCRUM
Technologies
Databricks, Apache Spark, AWS, Azure, Snowflake
Responsibilities
Conceptualize and implement data platform setup and management; Design and develop data pipelines; Implement data quality checks and validation; Monitor data workflows for performance and reliability; Create and maintain documentation for data processes and architecture.
Seniority
Senior, hands-on IC