Platform Administrator (Databricks)
Core
Manage and maintain a multi-tenant Databricks platform (dev/qa/prod) for data engineers, handling workspace configuration, cluster governance, job monitoring, and troubleshooting.
Role type
Senior Platform Administrator (Databricks)
Builds
Stable, secure, and performant Databricks workspaces and data lake infrastructure
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models
Required skills
Databricks workspace management, cluster policy configuration, Unity Catalog administration, AWS infrastructure (EC2, S3, IAM, VPC), Linux/Bash scripting, SQL, Python scripting, REST API/SDK usage, Delta Lake/Parquet/Hive file formats, cluster node family management
Preferred skills
Databricks REST API/SDK, schema evolution and time travel, Delta table debugging, Spark optimization, Kafka, Terraform, GitLab CI, cost monitoring
Technologies
Databricks, AWS (EC2, S3, IAM, VPC, SQS), Linux, Bash, Python, SQL, Delta Lake, Parquet, Hive, Kafka, Terraform, GitLab CI
Responsibilities
Manage multiple Databricks workspaces; Configure cluster policies, governance & compliance; Create & maintain Unity Catalog objects; Monitor and debug failed/long-running jobs; Troubleshoot cluster crashes and memory issues; Investigate Python/Spark errors and dependency conflicts; Assist users with configuration and permissions; Maintain documentation for platform rules and troubleshooting
Seniority
Senior, hands-on IC