Databricks Engineer
Core
Design, build, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, and SQL for large-volume structured and semi-structured datasets.
Role type
Senior Databricks Data Engineer
Builds
Reliable, curated data products for Health & Life Sciences initiatives
Domain
Health & Life Sciences, Cloud Data Engineering
Deliverable
production ML models
Required skills
Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Factory, CI/CD, performance optimization
Preferred skills
Health Payer project experience
Technologies
AWS, Azure, CI/CD, Databricks, PySpark, SQL, Spark, Unity, Cloud
Responsibilities
Design and build scalable ETL/ELT pipelines; Develop data ingestion and transformation frameworks; Apply Delta Lake patterns and implement data-quality checks; Tune Spark workloads and SQL queries for performance and cost efficiency; Work with analysts, architects, and source-system teams to deliver data products