Data Engineer - Databricks
Core
Act as Databricks Workspace Administrator managing platform operations, governance, and enablement for analytics, ML, and GenAI workloads.
Role type
Senior Databricks Platform Engineer
Builds
Databricks workspace infrastructure, Unity Catalog structures, and governance frameworks
Domain
Cloud Data Platform / Data Engineering
Deliverable
infrastructure
Required skills
Databricks Workspace Administration, Unity Catalog design, Identity and Access Management (IAM), CI/CD automation, SQL development, Hive/Glue and JDBC pipeline maintenance, Platform monitoring and alerting
Preferred skills
ML and Generative AI workload support, RAG and model serving workflows, Self-service onboarding model design, Cloud platform expertise (AWS or Azure)
Technologies
Databricks, Unity Catalog, Hive, Glue, JDBC, AWS, Azure
Responsibilities
Manage workspace governance including access controls, cluster policies, and cost/usage controls; Design and maintain Unity Catalog structures; Implement permission models aligned with compliance standards; Support CI/CD and non-human identity integration; Onboard and support tenant teams across analytics, ML, and GenAI; Develop platform monitoring, dashboards, and alerting solutions; Troubleshoot platform configuration and access issues; Maintain runbooks and platform standards.
Seniority
Senior, hands-on IC