Data Engineer
Core
Build governed data foundations, pipelines, and datasets to support machine learning and quantum computing workloads.
Role type
Senior Data Engineer
Builds
Secure data pipelines, governed datasets, and ML training/evaluation environments
Domain
Quantum computing, Machine Learning, Data Engineering
Deliverable
production ML models
Required skills
Databricks, Spark, Delta Lake, SQL, data pipeline design, data governance, data security, CI/CD, cloud infrastructure
Preferred skills
streaming data, regulated datasets, quantum computing, hybrid cloud environments
Responsibilities
Design and operate secure data ingestion and transformation pipelines; Build data workflows across cloud, private-cloud, on-premise, and datacentre environments; Develop governed datasets for ML and quantum workloads; Create robust training, validation, and test datasets; Transform raw customer data into QPU-permitted features; Monitor and optimize pipeline reliability and cost; Build automated testing and CI/CD practices for data infrastructure
Seniority
Senior, hands-on IC
