Principal Data Engineer
Core
Design and deliver production data pipelines on the Databricks Lakehouse to feed AI models and decisioning systems for member profiles, clinical signals, and behavioral data.
Role type
Principal Data Engineer (hands-on IC with team lead responsibilities)
Builds
Bronze/Silver/Gold medallion lakehouse pipelines powering the NBA platform
Domain
Healthcare insurance / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Delta Lake, SQL, Python, Spark, data modeling, data quality monitoring, contractor management
Preferred skills
Delta Live Tables, Unity Catalog, Feature Store, Kafka, real-time ingestion, healthcare data (PHI/HIPAA)
Technologies
Databricks, Delta Lake, SQL, Python, Spark, Kafka
Responsibilities
Design and build production SQL/Python/Spark pipelines; own Gold layer schema; implement data quality checks and alerting; onboard external data sources; manage data engineering contractors; partner with decision intelligence engineers
Seniority
Principal, hands-on IC with mentorship
