Managing Consultant, Databricks Data Engineering Lead
Core
Lead Databricks data engineering and DataOps delivery across ingestion, transformation, orchestration, migration, integration, serving, and consumption patterns for enterprise clients.
Role type
Senior IC Databricks Data Engineering Lead
Builds
Scalable data pipelines, migration utilities, transformation frameworks, and governed data products using Databricks, Apache Spark, and Delta Lake.
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models
Required skills
Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, DataOps, CI/CD, Git, Data Quality Controls, Enterprise Data Migration, Technical Leadership
Preferred skills
Unity Catalog, Delta Live Tables, Terraform, Azure DevOps, API Development, Public Sector Modernization
Technologies
Databricks, Apache Spark, Delta Lake, Python, SQL, Git, Azure DevOps, GitHub Actions, Jenkins, Terraform
Responsibilities
Lead engineering reviews and troubleshoot Databricks job failures; Design and develop reusable pipelines and migration utilities; Coordinate technical delivery with data architects and security specialists; Mentor data engineers and ensure adoption of design patterns; Communicate technical decisions and risks to client leadership.
Seniority
Senior, hands-on IC with leadership responsibilities