Data Platform Engineer Manager
Core
Design, build, and operate an enterprise-scale Databricks-based data mesh platform to enable domain autonomy for data engineers, analytics, and data science teams.
Role type
Manager, Data Platform Engineering
Builds
Enterprise data mesh platform on Databricks
Domain
AgTech / Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks Lakehouse, Spark SQL, Delta Lake, Unity Catalog, Python, PySpark, Scala, Terraform, CI/CD, Data Governance, Data Lineage, PII Anonymization
Preferred skills
Design thinking, POC/MVP delivery, Technology evaluation
Technologies
Databricks, Spark SQL, Delta Lake, Unity Catalog, Python, PySpark, Scala, Terraform, Azure, AWS, GCP
Responsibilities
Design and build enterprise-scale data mesh platform; Ensure platform reliability, scalability, and security; Enable data teams to ingest, process, and share data; Implement data governance frameworks; Orchestrate business initiatives and technology evaluations.
Seniority
Manager, hands-on technical leadership