Data Engineer / Databricks Platform Administrator
Core
Design, build, and operate a secure, scalable enterprise-grade Databricks platform on AWS while contributing to data pipeline development and governance.
Role type
Senior Data Engineer / Databricks Platform Administrator
Builds
Production-grade Databricks workspaces, Unity Catalog metastores, and secure AWS network architectures
Domain
Cloud Data Engineering (AWS, Databricks)
Deliverable
production ML models | infrastructure
Required skills
Databricks administration, Unity Catalog, AWS (VPC, Private Link, IAM, S3, Networking), Python, SQL, Infrastructure-as-Code (Terraform), CI/CD pipelines
Preferred skills
Terraform, CI/CD for infrastructure
Technologies
Databricks, AWS, Terraform, Unity Catalog, Python, SQL
Responsibilities
Design and implement Databricks workspaces on AWS; Configure and manage Unity Catalog and access controls; Design secure network architectures using AWS VPCs and Private Link; Implement IAM roles and cloud access models; Develop Infrastructure-as-Code solutions; Establish CI/CD pipelines for platform deployment; Define cluster policies and operational guardrails
Seniority
Senior, hands-on IC
