DataOps Engineer
Core
Build an intelligent, metadata-driven ingestion engine and automated framework for data onboarding, storage provisioning, and archiving on Azure Databricks and Unity Catalog.
Role type
Senior DataOps Engineer (Platform Engineering)
Builds
Automated data ingestion pipelines, landing zones, and Unity Catalog assets for enterprise data platforms.
Domain
Cloud Data Engineering (Azure Databricks, Unity Catalog, Delta Lake) (via careerplan.io/jobs/R168525-1-dataops-engineer-at-mars)
Required skills
Python, PySpark, SQL, Azure Databricks, Delta Lake, Unity Catalog, CI/CD, Git, Terraform, Databricks Asset Bundles
Preferred skills
Delta Live Tables, dbt, automated data retention policies, cloud archival storage
Responsibilities
Design metadata-driven frameworks for dynamic pipeline orchestration; maintain high-throughput landing zones with automated data quality safeguards; automate Unity Catalog asset creation and lifecycle management; implement CI/CD testing and deployment for data workflows.