Data Engineer
Core
Architect, build, and maintain robust data pipelines that clean, standardize, and transform raw data into actionable insights for the insurance marketplace.
Role type
Data Engineer (ETL & Pipeline Architecture)
Builds
High-volume data transformation pipelines and supporting microservices for data exchange platform
Domain
Insurance technology / Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
ETL pipeline design, SQL (relational & non-relational), Cloud platforms (AWS/GCP/Azure), CI/CD, Containerization (Docker/Kubernetes), Ruby
Preferred skills
Proprietary DSL development, Microservices architecture
Technologies
PostgreSQL, MySQL, Ruby, AWS, GCP, Azure, Docker, Kubernetes
Responsibilities
Architect and implement high-volume data transformation pipelines using proprietary ETL solution; Define logic using custom DSL to clean, enrich, and integrate disparate data sources; Monitor, troubleshoot, and optimize data pipelines for integrity and low latency; Design and deploy supporting scripts and microservices for complex requirements; Propose improvements to ETL processes and underlying infrastructure
Seniority
Mid-Senior, hands-on IC