DBA (Databricks)
Core
Manage Databricks workspaces, clusters, and governance for a ticketing platform customer.
Role type
Senior Databricks DBA (Infrastructure & Operations)
Builds
Databricks workspaces, cluster policies, Unity Catalog objects, and job pipelines for a ticketing company.
Domain
Cloud Data Engineering (AWS + Databricks)
Deliverable
production ML models
Required skills
Databricks administration, AWS infrastructure (EC2, S3, IAM, VPC), Linux/Bash, SQL, Python scripting, Unity Catalog, Delta Lake, Spark troubleshooting, REST API/SDK
Preferred skills
Databricks REST API/SDK, Schema evolution, Time travel, Vacuum/Compaction, Z-order, Delta table debugging, Kafka, Terraform, GitLab CI, Cost monitoring
Technologies
Databricks, AWS (EC2, S3, IAM, VPC, SQS), Linux, Bash, Python, SQL, Delta Lake, Parquet, Hive, Kafka, Terraform, GitLab CI
Responsibilities
Manage multiple Databricks workspaces (dev/qa/prod), Configure cluster policies and governance, Create and maintain Unity Catalog objects, Monitor and debug failed or long-running jobs, Troubleshoot cluster crashes and memory issues, Investigate Python/Spark errors and dependency conflicts, Assist users with cluster configuration and permissions, Maintain documentation for platform rules and troubleshooting
Seniority
Senior, hands-on IC