Manager Big Data Engineering - Databricks Lead - Hybrid
Core
Lead the design, delivery, and modernization of enterprise-scale data platforms and AI-ready data foundations using Databricks and cloud-native technologies.
Role type
Manager, Data Engineering (Databricks Lead)
Builds
Enterprise-scale Lakehouse architectures, scalable data products, and AI-enabled data services
Domain
Data Engineering, Cloud Platforms, AI Engineering
Deliverable
production ML models
Required skills
Databricks, Python, Apache Spark, Cloud Data Platforms (AWS/Azure/GCP), Data Modeling, CI/CD, MLOps, Vector Databases, Retrieval Systems
Preferred skills
Databricks Certifications, Cloud Certifications, Generative AI/LLM lifecycle experience, Industry domain expertise (Retail/Finance/Healthcare)
Technologies
Databricks, Delta Lake, Spark SQL, AWS, Azure, GCP, Snowflake, BigQuery, DynamoDB, Vertex AI, Azure AI Services
Responsibilities
Lead architecture and delivery of enterprise-scale data engineering solutions; Drive data modernization from traditional to lakehouse ecosystems; Lead development of batch and streaming pipelines; Partner with stakeholders on roadmaps and governance; Mentor engineers and provide technical leadership; Support AI-enabled use cases including RAG and agentic architectures.
Seniority
Manager, hands-on technical leadership