Infrastructure Data Engineer
Core
Design, implement, and optimize Azure Databricks environments and a broad range of Azure services to ensure a secure, scalable, and cost-efficient cloud ecosystem.
Role type
Senior IC Azure Cloud Engineer (Databricks & Platform)
Builds
Azure Databricks workspaces, clusters, jobs, pipelines; Azure Web Apps, Function Apps, API Management; Data Factory pipelines; Storage Accounts; Azure SQL/Cosmos DB; IaC templates.
Domain
Cloud Infrastructure & Data Engineering (Microsoft Azure)
Deliverable
production ML models | infrastructure
Required skills
Azure Databricks, Spark, Delta Lake, Terraform, Bicep, ARM, PowerShell, Python, Bash, Azure Monitor, Log Analytics, Azure Advisor, cloud networking (VNETs, private endpoints)
Preferred skills
Azure certifications (AZ-104, AZ-204, DP-203, AZ-305, Databricks), CI/CD pipelines (Azure DevOps, GitHub Actions), Unity Catalog, Databricks SQL, MLflow
Technologies
Azure Databricks, Azure Data Factory, Azure Application Gateway, Azure Storage, Azure SQL, Cosmos DB, Terraform, Bicep, ARM, Azure DevOps, GitHub Actions, PowerShell, Python, Bash
Responsibilities
Design and optimize Databricks clusters and job orchestration; Build scalable ETL/ELT pipelines using Delta Lake and Spark; Deploy and maintain Azure Web Apps, Function Apps, and API Management; Manage Azure Storage lifecycle and access controls; Implement security controls including Unity Catalog and RBAC; Build and maintain IaC templates for automated deployments.
Seniority
Mid-Senior, hands-on IC
