Senior Data Engineer [Remote-US]
Core
Design and build robust data pipelines and streaming services to integrate diverse data sources for risk evaluation, business intelligence, and enabling data science model training and inference.
Role type
Senior IC data engineer (cloud & streaming)
Builds
Data pipelines, streaming data services, curated datasets, and ML infrastructure
Domain
Insurance / Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, AWS data platforms (Glue, S3, Athena, Lambda, Step Functions), Snowflake, Kafka/Kinesis, workflow orchestration (Airflow), Terraform, data modeling, CI/CD for ML
Preferred skills
Insurance industry experience, ML infrastructure design, feature stores, data governance tools
Technologies
Kafka, AWS, Snowflake, Airflow, Terraform, Python, SQL
Responsibilities
Design and build robust data pipelines integrating data from diverse sources; Build streaming data pipelines using Kafka and AWS services; Create and operate data services accessible via APIs; Support data science workflows for model training and inference; Implement data quality frameworks; Contribute to CI/CD pipelines and infrastructure-as-code; Deliver reliable services with on-call support; Create well-modeled datasets in Snowflake.
Seniority
Senior, hands-on IC