Senior Software Engineer, Data Platform
Core
Design, build, and operate the end-to-end data warehouse platform including CDC pipelines, streaming transport, data lake, query layer, and transformation tools for a healthcare AI operating system.
Role type
Senior IC Data Platform Engineer
Builds
Data warehouse platform, CDC pipelines, data lake, query/serving layer, and analytics tooling
Domain
Healthcare technology / Modern Data Stack
Deliverable
production ML models
Required skills
CDC pipelines (Debezium), streaming (Kafka, Redpanda), data lake formats (Iceberg, Delta Lake, Hudi), MPP/lakehouse engines (StarRocks, ClickHouse, Trino, Snowflake, Databricks), dbt, SQL, schema design, query optimization, orchestration (Airflow, Dagster), observability, data quality
Preferred skills
Semantic layers (dbt Semantic Layer, Cube), data catalogs/lineage (DataHub, OpenMetadata, Amundsen), HIPAA-regulated data handling, AI/ML workloads (feature stores, embedding pipelines), multi-cloud (AWS, GCP, Azure), infrastructure-as-code (Terraform, Pulumi), Kubernetes
Technologies
Debezium, Kafka, Redpanda, Iceberg, Delta Lake, Hudi, StarRocks, ClickHouse, Trino, Snowflake, Databricks, dbt, Airflow, Dagster, Terraform, Pulumi, Kubernetes
Responsibilities
Own the data warehouse platform end-to-end; Design and operate CDC pipelines with Debezium; Architect the data lake on object storage; Run and scale StarRocks as the query and serving layer; Build the transformation layer with dbt; Stand up orchestration and CI/CD tooling; Partner with Security and Compliance on PHI/PII handling; Collaborate with product and analytics teams on schema contracts
Seniority
Senior, hands-on IC