Enterprise Data & Analytics Operations Engineer
Core
Operate and maintain the production data pipeline infrastructure, ensuring reliability, automation, and quality for enterprise analytics.
Role type
Data & Analytics Operations Engineer (DataOps)
Builds
Automated, reliable data pipelines and 'Gold-layer' analysis-ready datasets
Domain
Consumer packaged goods (CPG) / Healthcare / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Azure Data Factory, Databricks, Spark SQL, PySpark, SQL, Git, CI/CD workflows, Root-Cause Analysis
Preferred skills
Azure Data Engineer Associate certification, Databricks Certified Professional Data Engineer
Technologies
Azure Databricks, Azure Data Lake Storage (ADLS), Azure Data Factory, Delta Lake, Unity Catalog, Azure DevOps
Responsibilities
Monitor and troubleshoot data pipeline jobs; perform data mapping and quality assurance checks; write and optimize Spark SQL/PySpark code for automation; create technical documentation for data models and workflows; collaborate with stakeholders to translate business requirements into technical solutions.
Seniority
Junior to Mid-level, hands-on IC