Principal Engineer - Data Engineering
Core
Build and maintain ML-ready scientific data pipelines for experimental measurement data from precision product development instruments.
Role type
Principal Data Engineer (Scientific Data & MLOps)
Builds
Versioned feature engineering pipelines, data quality frameworks, training data registries, and synthetic data ingestion infrastructure.
Domain
AI/ML infrastructure, scientific data engineering, precision product development
Deliverable
production ML models
Required skills
Python, SQL, scalable pipeline design, data quality principles, data versioning & lineage, ML data lifecycle awareness
Preferred skills
Feature stores (Feast, Tecton), synthetic data generation (VAE, GAN), DBT, data lakehouse (Iceberg, Dremio), annotation platform integration
Technologies
AWS Kubernetes, PortKey, Agent Gateway, LangFuse, AWS Guardrails, Elastic Search, Airflow, Prefect, AWS Glue Jobs (via careerplan.io/jobs/744000153657499-principal-engineer-data-engineering-at-western-digital)
Responsibilities
Design and operate data quality checks for AI training datasets; implement data contracts between upstream producers and downstream ML consumers; build training dataset registry and feature store; contribute to real-time sensor data ingestion pipelines; support synthetic data generation workstreams.
Seniority
Junior (0-1 years experience), hands-on IC
