Senior Databricks & AI Platform Engineer
Core
Building robust, scalable data and AI platforms on Databricks to move ML/AI solutions from experiment to production for enterprise clients.
Role type
Senior Data & AI Platform Engineer
Builds
Standardized, reusable data and AI platforms on Databricks (Azure/AWS) enabling model training, inference, and monitoring.
Domain
Data Engineering & AI Platform Engineering
Deliverable
production ML models
Required skills
Databricks (3+ years), Python, SQL, PySpark, ML pipeline orchestration, DevSecOps, data modeling (3NF, dimensional, medallion), Unity Catalog, metadata governance
Preferred skills
Mosaic AI, Azure and AWS environments, financial services industry
Technologies
Databricks, Unity Catalog, Collibra, Azure, AWS, Python, SQL, PySpark
Responsibilities
Design and build scalable data/AI platforms on Databricks; implement ML/AI workflows for training, inference, and monitoring; develop data pipelines and compute-intensive backends; integrate governance and metadata solutions; optimize performance, scalability, and costs; coach and mentor team members.
Seniority
Senior, hands-on IC with mentorship