Data Engineer - DataOps
Core
Build, scale, and maintain core data pipelines delivering trusted sell-through, actuals, and strategic business data to global Sales & Finance leadership for a high-profile client.
Role type
Senior Data Engineer (DataOps focus)
Builds
Production data pipelines, shared pipeline estate, automated data quality checks, and monitoring tooling
Domain
Sales, Finance, and supply chain data domains
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Expert SQL, Python, Airflow, Spark, Trino/Dremio, Apache Iceberg, Kafka, Docker, Git, CI/CD
Preferred skills
Java or Scala, lakehouse architectures, Sales/Finance/supply chain domain context
Technologies
Apache Airflow, Apache Spark, Trino, Dremio, Apache Iceberg, Kafka, Docker
Responsibilities
Develop and maintain efficient ingestion and transformation pipelines; orchestrate and monitor workflows using Apache Airflow; drive platform-wide reliability and DAG hardening; design and deploy automated Data Quality Checks and monitoring; manage asset lifecycles and support engine migrations; own production incident response and Root Cause Analyses
Seniority
Senior, hands-on IC