Principal Data Engineer
Core
Own the technical direction and execution of the data engineering platform, setting architectural direction for systems that collect, process, store, and serve data at scale for AI data center power orchestration.
Role type
Principal Data Engineer (Staff-level IC with leadership)
Builds
Core platform components including ingestion pipelines, transformation frameworks, data models, and orchestration for the Karman platform
Domain
Energy infrastructure / AI data centers / Cloud data infrastructure
Deliverable
production ML models | infrastructure
Required skills
End-to-end data platform design, batch and streaming pipeline patterns, data modeling and storage strategies, cloud infrastructure (AWS/GCP/Azure), technical leadership, architectural decision-making, code quality evaluation
Preferred skills
Streaming architectures (Spark Structured Streaming, Delta Live Tables, Kafka), data quality and observability tooling, visualization tools (Databricks Dashboards, Tableau, Sigma, Power BI), edge device data collection, ML workflow support
Technologies
Spark Structured Streaming, Delta Live Tables, Kafka, Great Expectations, Monte Carlo, Soda, Databricks, AWS, GCP, Azure
Responsibilities
Architect and contribute to core platform components; define and evolve the multi-quarter technical roadmap; lead architecture reviews and design discussions; mentor and grow engineers; set code review standards and engineering best practices; ensure data systems reliability in production with clear SLAs
Seniority
Principal, hands-on IC with strategic direction and team growth
