Sr. Software Engineer_Cloud_Devops
Core
Ensure stability, scalability, and performance of cloud-based data pipelines and optimize Databricks workloads.
Role type
Senior IC Cloud DevOps Engineer (Data Pipelines)
Builds
Batch data pipelines and cloud infrastructure for automotive domain analytics
Domain
Automotive / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Cloud infrastructure management, Databricks, Lakehouse architecture, Batch accounts, Infrastructure as Code (IaC), CI/CD pipelines, Command-line scripting (PowerShell), Data pipeline orchestration (Azure Data Factory), Monitoring and logging
Preferred skills
Automotive domain experience, Advanced monitoring tools expertise
Technologies
Databricks, Azure Data Factory, GitHub, PowerShell, Batch accounts, IaC
Responsibilities
Monitor and maintain batch data pipelines in cloud environments, Optimize Databricks workloads for efficiency and cost reduction, Analyze and fine-tune cloud infrastructure for cost optimization, Improve operational processes including incident handling and issue resolution
Seniority
Senior, hands-on IC
