Senior Data Platform Engineer
Core
Build, operate, and optimize large-scale batch pipelines to transform healthcare claims and EHR data into trusted, serving-ready data products.
Role type
Senior IC data platform engineer
Builds
Production data pipelines and serving-ready data products
Domain
Healthcare data infrastructure on AWS
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark, Apache Airflow, AWS, data storage formats (Iceberg, Delta Lake, Hudi), pipeline debugging, system design
Preferred skills
Docker, Kubernetes, data governance, data lineage, APIs, AI/agentic workflows
Technologies
Python, SQL, Spark, Airflow, AWS, Iceberg, Delta Lake, Hudi, Docker, Kubernetes
Responsibilities
Build and optimize multi-terabyte batch pipelines; Ingest data from external sources; Transform healthcare claims and EHR data; Improve data quality, validation, and observability; Debug complex system and performance issues; Contribute to system design and CI/CD; Mentor engineering teams
Seniority
Senior, hands-on IC
