CareerPlan

Platform Administrator (Databricks)

RemoteFull-time2026-11-17
Remote

Core

Manage and maintain a multi-tenant Databricks platform (dev/qa/prod) for data engineers, handling workspace configuration, cluster governance, job monitoring, and troubleshooting.

Role type

Senior Platform Administrator (Databricks)

Builds

Stable, secure, and performant Databricks workspaces and data lake infrastructure

Domain

Cloud Data Engineering / Big Data

Deliverable

production ML models

Required skills

Databricks workspace management, cluster policy configuration, Unity Catalog administration, AWS infrastructure (EC2, S3, IAM, VPC), Linux/Bash scripting, SQL, Python scripting, REST API/SDK usage, Delta Lake/Parquet/Hive file formats, cluster node family management

Preferred skills

Databricks REST API/SDK, schema evolution and time travel, Delta table debugging, Spark optimization, Kafka, Terraform, GitLab CI, cost monitoring

Technologies

Databricks, AWS (EC2, S3, IAM, VPC, SQS), Linux, Bash, Python, SQL, Delta Lake, Parquet, Hive, Kafka, Terraform, GitLab CI

Responsibilities

Manage multiple Databricks workspaces; Configure cluster policies, governance & compliance; Create & maintain Unity Catalog objects; Monitor and debug failed/long-running jobs; Troubleshoot cluster crashes and memory issues; Investigate Python/Spark errors and dependency conflicts; Assist users with configuration and permissions; Maintain documentation for platform rules and troubleshooting

Seniority

Senior, hands-on IC