Data Engineer
Core
Design, develop, and maintain scalable cloud-native data platforms and pipelines for analytics, reporting, and scientific research in the fusion energy domain.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Distributed data processing workflows, cloud-native data solutions, and data quality frameworks for scientific research and analytics.
Domain
Fusion Energy / Deep-Tech / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Apache Spark, pySpark, Databricks, Delta Lake, Python, SQL, AWS services, Terraform, Infrastructure as Code, CI/CD, Data Quality frameworks, Git workflows, OIDC, MLflow
Preferred skills
Docker, containerized workloads, experiment optimization libraries, ML feature engineering, data governance, AI tooling restriction in secure environments
Technologies
Apache Spark, Databricks, AWS (S3, IAM, KMS, Batch, ECR, EventBridge, Lambda, API Gateway), Azure, Terraform, Databricks Asset Bundles, Unity Catalog, Great Expectations, Soda, pyDeequ, Databricks DQX, MLflow, Git
Responsibilities
Design and maintain scalable data pipelines; Build distributed data processing workflows; Model and optimize data structures; Integrate data from heterogeneous sources; Implement data quality controls and lineage tracking; Optimize performance and cost-efficiency; Collaborate with scientists and engineers to translate requirements into technical solutions; Contribute to CI/CD and infrastructure automation.
Seniority
Senior, hands-on IC