Senior Data Engineer
Core
Design and build scalable cloud-native data platforms, implement near-real-time ingestion pipelines, and modernize large-scale data infrastructure for a fusion energy company.
Role type
Senior IC data engineer (cloud-native platforms)
Builds
Cloud-native data platforms, near-real-time ingestion pipelines, self-service tooling, and microservices
Domain
Deep-tech / Fusion energy / Cloud data engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Databricks, Delta Lake, AWS (S3, IAM, EventBridge, Lambda), Terraform, CI/CD, Data quality frameworks, MLflow
Preferred skills
Docker, experiment optimization tools, feature engineering, regulated environment experience
Technologies
Databricks, AWS, Terraform, Databricks Asset Bundles, MLflow, Great Expectations, Soda, pyDeequ, Databricks Labs DQX
Responsibilities
Design and build scalable cloud-native data platforms; implement near-real-time ingestion pipelines; refactor and optimize Spark/PySpark scripts; enforce data platform standards; introduce best practices for code quality and CI/CD; drive adoption of AI tooling; ensure data quality and observability; design self-service tooling; monitor platform performance and costs.
Seniority
Senior, hands-on IC