Principal Data Engineer
Core
Design and evolve data-platform architecture, ETL workflows, and data models to support experimentation and scorecards.
Role type
Principal Data Engineer (AI-native engineering)
Builds
Scalable data solutions, production-grade deployments, and data agents for pipeline investigation
Domain
Data Engineering / AI Engineering
Deliverable
production ML models
Required skills
Spark, Python, SQL, Delta Lake, Parquet, Infrastructure as Code, CI/CD, RBAC, System Design, AI integration, Observability, Root-cause analysis
Preferred skills
Databricks, Open table formats, Distributed systems
Technologies
Spark, Python, SQL, Delta Lake, Parquet, Databricks
Responsibilities
Design and evolve ETL workflows and data pipelines; Build scalable, secure APIs and data access controls; Provision resources through Infrastructure as Code; Deliver production-grade deployments through CI/CD; Apply AI across design, coding, testing, and troubleshooting; Build data agents to investigate pipeline failures and performance; Automate safe deployments and diagnostic workflows
Seniority
Principal, hands-on IC & strategy