Databricks Lead Engineer | Senior Manager | Data & AI | Advisory
Core
Lead the development and delivery of analytics projects enhancing healthcare outcomes by building robust data solutions on Databricks.
Role type
Senior Manager / Lead Data Engineer (Healthcare)
Builds
Scalable data lakes/lakehouses, complex batch and streaming pipelines, and automated workflows for healthcare systems.
Domain
Healthcare data & AI
Deliverable
production ML models | infrastructure
Required skills
PySpark, Scala, Delta Lake, Unity Catalog, SQL, Databricks Notebooks/Workflows, Azure/AWS, CI/CD, data modeling, architectural design, team leadership, stakeholder management
Preferred skills
Deep Spark expertise, experience in complex matrix environments, mentoring engineers
Technologies
Databricks, PySpark, Scala, Delta Lake, Unity Catalog, Azure, AWS, Git, ADO
Responsibilities
Develop scalable data solutions and define data models; Build and optimize complex data pipelines; Guide development teams and mentor engineers; Implement data quality checks and security measures; Work with cloud services and manage Databricks clusters; Partner with data scientists and business stakeholders to translate requirements into technical solutions.
Seniority
Senior Manager, hands-on IC with leadership
