Senior Data Engineer
Core
Design and implement scalable, self-service data pipelines and orchestration platforms for mission-critical ML and AI workflows.
Role type
Senior IC data engineer (platform & governance)
Builds
On-premises data orchestration platform, self-service pipeline capabilities, data quality testing frameworks
Domain
Enterprise data engineering, ML/AI data infrastructure
Deliverable
production ML models
Required skills
Data orchestration, SQL, Python, stream processing, containerized deployment, data quality frameworks, CI/CD for data pipelines, Kubernetes optimization
Preferred skills
Self-hosted orchestration platforms, data contracts/schema governance, real-time streaming architectures, data modeling/warehouse design, technical leadership
Technologies
Kubernetes, open source orchestration tools, SQL, Python
Responsibilities
Design and maintain on-premises data orchestration platform; Create self-service capabilities for data pipeline deployment; Implement data quality testing frameworks; Establish data engineering best practices (version control, CI/CD); Collaborate with ML/AI teams on feature engineering pipelines; Develop reusable patterns for data integration; Optimize Kubernetes-based data platform; Mentor junior engineers
Seniority
Senior, hands-on IC with mentorship