Senior DevOps Databricks Engineer
Core
Design, build, and operate enterprise-grade data and ML platforms on AWS and Databricks for a Financial Crime platform, focusing on infrastructure, governance, security, and operations.
Role type
Senior DevOps Databricks Engineer
Builds
Scalable, secure, and compliant data and ML platforms on AWS and Databricks
Domain
Financial Crime / Fintech / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks administration, AWS cloud infrastructure, Unity Catalog governance, Infrastructure-as-Code (IaC), CI/CD pipelines, ML model deployment, cluster optimization, security best practices, system performance diagnosis
Preferred skills
Regulated environment operations (banking/fintech), mentoring engineering teams, architectural best practices definition
Technologies
Databricks, AWS (S3, Redshift, Kinesis, Lambda, EKS/ECS), Delta Lake, Unity Catalog
Responsibilities
Architect and operate end-to-end data and ML platforms; Administer Databricks workspaces; Lead DevSecOps and DataOps practices; Configure and optimize Databricks compute clusters; Manage and enforce governance through Unity Catalog; Build and operate ML infrastructure including model serving; Integrate AWS services with Databricks runtime; Implement platform security best practices; Optimize system performance and diagnose production issues; Mentor engineering teams and define architectural best practices
Seniority
Senior, hands-on IC
