Lead Data Engineer
Core
Design, build, and operate modern Databricks and Lakehouse data platforms supporting advanced analytics, AI, and Generative AI use cases including LLM and agent-based systems.
Role type
Senior individual contributor Lead Data Engineer
Builds
Scalable, governed, and reliable Lakehouse architectures and data pipelines for analytics and AI workloads
Domain
Data Engineering, Generative AI, Lakehouse
Deliverable
production ML models
Required skills
Databricks, Delta Lake, Unity Catalog, Apache Spark, Python, SQL, CI/CD, automated testing, data lineage, RAG patterns
Preferred skills
Generative AI data enablement, mentorship, cross-functional collaboration
Technologies
Databricks, Delta Lake, Unity Catalog, Apache Spark, Python, SQL
Responsibilities
Design and operate Databricks solutions (Jobs, Workflows, Notebooks), build pipelines for GenAI (RAG, context prep), implement production-grade pipelines with testing and deployment, ensure data quality and operational stability, mentor AI Engineers, support incident resolution and governance
Seniority
Senior, hands-on IC