DataOps Engineer
Core
Building and operating a Databricks-native medallion architecture (Bronze → Silver → Gold) on Microsoft Azure, integrating AI-driven observability and self-healing capabilities for enterprise data infrastructure.
Role type
Senior DataOps Engineer (Platform Engineering)
Builds
Self-aware, self-healing data pipelines and agentic monitoring workflows for a global real estate platform.
Domain
Real Estate / Cloud Data Engineering / AI Observability
Deliverable
production ML models | infrastructure
Required skills
Databricks (Delta Live Tables, Unity Catalog, Spark tuning), Azure Data Services (ADF, ADLS Gen2, Monitor), Python/Scala, SQL, CI/CD (GitHub Enterprise), AI tooling for observability (LLMs, anomaly detection), medallion architecture patterns
Preferred skills
Linear for sprint management, Databricks Mosaic AI/Genie, agentic AI frameworks, real estate/ERP domain knowledge, Cosmos DB/Azure SQL
Technologies
Databricks, Delta Live Tables, Unity Catalog, PySpark, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Monitor, GitHub Enterprise, Linear, OpenAI APIs
Responsibilities
Implement AI-powered observability and agentic monitoring workflows; Operate and optimize the full Azure data services stack; Design and maintain Databricks data pipelines and governance standards; Own the full CI/CD deployment lifecycle from dev to production; Instrument data quality checks across medallion layers; Partner with governance teams to enforce data contracts and SLAs
Seniority
Senior, hands-on IC