Senior DataOps Engineer, Data Platform Section - Data Platform Department (DPD)
Core
Lead the design and delivery of multi-cloud data pipeline infrastructure, enabling self-service data platform adoption across 70+ business units.
Role type
Senior IC DataOps Engineer (Data Platform)
Builds
Reusable CI/CD templates, automated testing/rollback frameworks, and multi-cloud data ingestion/transformation pipelines
Domain
Cloud Data Engineering / Multi-cloud Infrastructure
Deliverable
production ML models
Required skills
DataOps, CI/CD for data pipelines, GCP data services (BigQuery, Dataflow, Cloud Composer, Pub/Sub), Azure data services (Databricks, Azure Data Factory, ADLS), Apache Spark, Python, Apache Airflow, CI/CD automation tools (GitHub Actions, Cloud Build, Jenkins), Infrastructure-as-code (Terraform), SQL
Preferred skills
Apache Iceberg or Delta Lake, platform engineering or developer-experience (DX) roles, streaming pipelines (Kafka, Dataflow Streaming, Apache Flink), multi-BU or enterprise-scale data platform environments, data mesh or federated data platform operating models
Technologies
GCP BigQuery, Dataflow, Cloud Composer, Pub/Sub, Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Apache Spark, Python, Apache Airflow, GitHub Actions, Cloud Build, Jenkins, Terraform, Apache Iceberg, Delta Lake, Kafka, Apache Flink
Responsibilities
Lead design and implementation of standardized pipeline templates for multi-cloud data ingestion, transformation, and delivery; Build and maintain CI/CD standards and tooling; Implement automated testing, validation, and rollback frameworks; Lead BU onboarding to the data platform; Drive adoption of Open Table Format (OTF / Apache Iceberg); Operate and improve Apache Airflow orchestration environments; Partner with the Data Governance team to enforce metadata and lineage capture; Mentor junior DataOps Engineers
Seniority
Senior, hands-on IC