Senior Databricks & AI Platform Engineer
Core
Designing and building scalable data and AI platforms on Databricks to move AI solutions from experiment to production for end customers and employees.
Role type
Senior Data & AI Platform Engineer
Builds
Robust, standardized, and reusable data and AI platforms enabling ML model training, inference, and monitoring.
Domain
Data Engineering & AI Platform Engineering on Databricks (Azure/AWS)
Deliverable
production ML models
Required skills
Databricks, Python, SQL, PySpark, ML pipeline orchestration, DevSecOps, data modeling (3NF, dimensional, medallion), Unity Catalog, metadata governance
Preferred skills
Mosaic AI, Azure, AWS, financial services domain
Technologies
Databricks, Azure, AWS, Python, SQL, PySpark, Unity Catalog, Collibra, Mosaic AI
Responsibilities
Design, build, and optimize data and AI platforms on Databricks; Implement ML and AI workflows for training, inference, and monitoring; Develop data pipelines and compute-intensive backends; Integrate governance and metadata solutions; Improve performance, scalability, and cost management; Coach and guide fellow engineers.
Seniority
Senior, hands-on IC with mentorship