Databricks Platform Engineer
Core
Administer and maintain Databricks environments to support enterprise analytics and data engineering workloads, ensuring platform reliability and operational efficiency.
Role type
Senior IC Databricks Platform Engineer
Builds
Cloud-based data infrastructure, data ingestion frameworks, and automation solutions within Azure.
Domain
Healthcare / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Databricks administration, Terraform, Azure cloud services, SQL, data ingestion, data modeling, data governance, Unity Catalog, incident response, root cause analysis
Preferred skills
Azure Data Lake, Snowflake, Python automation, CI/CD, regulated industry experience
Technologies
Azure, Databricks, Terraform, Unity Catalog, Snowflake, Python, SQL
Responsibilities
Administer and maintain Databricks environments; Manage platform configurations, cluster performance, and capacity planning; Monitor platform health and resolve operational issues; Develop and maintain Infrastructure as Code solutions using Terraform; Implement automation to improve platform consistency; Build and support data ingestion frameworks; Collaborate with Data Engineers to optimize processing workloads; Support data governance initiatives using Unity Catalog; Participate in incident response and root cause analysis.
Seniority
Senior, hands-on IC