Senior Data Platform Engineer
Core
Design, build, and operate large-scale data pipelines and foundational systems to transform complex healthcare datasets into trusted data assets for customer-facing products and AI/ML use cases.
Role type
Senior Data Platform Engineer
Builds
Production-grade data pipelines, storage systems, and data products
Domain
Healthcare data engineering on AWS
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark, Apache Airflow, AWS, data pipeline architecture, data quality validation, distributed systems, root-cause analysis
Preferred skills
Docker, Kubernetes, data governance, API design, AI/ML workflows
Technologies
Python, SQL, Spark, Airflow, AWS, Iceberg, Delta Lake, Hudi
Responsibilities
Build and optimize large-scale batch pipelines; make storage and data layout decisions; ingest data from external sources; transform healthcare claims and EHR data; strengthen reliability through data quality checks and observability; debug complex data and performance issues; contribute to system design and CI/CD.
Seniority
Senior, hands-on IC
