Data Engineer / Platform Administrator (Azure Databricks)
Core
Administering a large-scale Azure Databricks platform and building data pipelines for a health system.
Role type
Platform Administrator / Data Engineer
Builds
Automation, monitoring solutions, and data pipelines for a data lake
Domain
Healthcare / Cloud Data Platform
Deliverable
infrastructure
Required skills
Azure Databricks, Python (object-oriented), SQL, Cloud solutions (Azure/AWS/GCP)
Preferred skills
Infrastructure as Code (Terraform), CI/CD automation, REST APIs, Containerization (Docker/Podman) (via careerplan.io/jobs/R-69089-data-engineer-platform-administrator-azure-databricks-at-vumc)
Technologies
Azure Databricks, Python, SQL, Terraform, GitLab, GitHub, Azure DevOps, Docker, Podman
Responsibilities
Administer 100+ Databricks workspaces including compute policies and access controls; Build IaC to provision and manage workspaces at scale; Develop proactive monitoring tools for platform health and costs; Design and optimize performance-focused data pipelines; Troubleshoot production pipeline issues
Seniority
Junior to Mid-level, hands-on IC
