Director, Data Engineer (Python, Pyspark, MLOPs, LLMOPs, SQL, Databricks)
Core
Architecting the destination state for high-volume data pipelines, MLOps/LLMOps platforms, and automated evaluation frameworks to scale AI workflows at enterprise scale.
Role type
Director, Data Engineering (Strategic IC + Team Leadership)
Builds
Scalable data pipelines, MLOps/LLMOps systems, automated evaluation frameworks, and production-grade AI capabilities.
Domain
Enterprise Data Engineering, AI/ML Operations, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Databricks, MLOps, LLMOps, Distributed System Architecture, Pipeline Orchestration, Cloud Infrastructure, Data Modeling, CI/CD Governance
Preferred skills
Master's degree in CS/Data Science, Experience with numerical processing libraries, Experience with automated regression/evaluation suites
Technologies
Python, PySpark, SQL, Databricks, Cloud Platforms
Responsibilities
Architect destination state for high-volume data pipelines; Design robust evaluation frameworks and automated quality gates; Establish MLOps/LLMOps practices and system telemetry; Partner with cross-functional leaders to define technical roadmaps; Architect solutions for data isolation and metadata management; Lead modernization of production data platforms.
Seniority
Director, Strategic Leadership