Data Engineer
Core
Build scalable, governed, production-grade data pipelines and analytics products on the Databricks Lakehouse Platform to transform raw data into trusted, reusable data products supporting enterprise analytics and downstream applications.
Role type
Senior Data Engineer (Lakehouse Platform)
Builds
Scalable ETL/ELT pipelines, data products, and analytics infrastructure on Databricks
Domain
Healthcare / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Apache Spark, SQL, Python, CI/CD, Data Modeling, Data Governance
Preferred skills
AWS (EC2, S3, Lambda), Delta Lake, PySpark/Scala, Data Quality Frameworks, Cloud Platforms, Regulated Environment Experience
Technologies
Databricks, Apache Spark, SQL, Python, AWS, Azure, GCP, Delta Lake, Git
Responsibilities
Design and maintain scalable enterprise data products and pipelines; Monitor and optimize Spark/Databricks workloads; Collaborate with Data Science, Analytics, and DevOps teams; Troubleshoot data pipeline issues and ensure data quality; Implement best practices for layered data modeling and Lakehouse design; Ensure compliance with data privacy standards (PHI handling)
Seniority
Senior, hands-on IC