Data Bricks Developer
Core
Operations Engineer supporting an Azure-based Data Engineering platform powered by Databricks, focusing on system reliability, security auditing, and workflow automation.
Role type
Senior IC Operations Engineer (Data Platform)
Builds
Robust, secure, and scalable data infrastructure on Azure and Databricks
Domain
Cloud Infrastructure (Azure) + Data Engineering (Databricks)
Deliverable
infrastructure
Required skills
Azure services, Databricks, Python, Bash, CI/CD tools, Infrastructure-as-Code, System monitoring, Security auditing
Preferred skills
Databricks Security Analysis Tool (SAT), Unity Catalog, RBAC, MLOps, Cost optimization
Technologies
Azure DevOps, Terraform, ARM templates, Azure Monitor, Log Analytics, Prometheus, Azure Key Vault, Databricks SAT
Responsibilities
Maintain and monitor Databricks-based data pipelines and Azure data services; Implement CI/CD pipelines for data engineering workflows; Conduct system health checks and performance tuning; Automate infrastructure provisioning; Perform security audits; Manage secrets and credentials securely; Collaborate with security teams on access control and encryption policies; Maintain operational runbooks and incident response documentation.
Seniority
Senior, hands-on IC