Principal Staff Software Engineer - Data Lake Infrastructure
Core
Design and operate OpenHouse, LinkedIn's open-source control plane for Apache Iceberg tables, and the broader data lake stack serving petabyte-scale datasets for analytics, ML, and AI workloads.
Role type
Principal Staff Software Engineer (Data Lake Infrastructure)
Builds
OpenHouse (Apache Iceberg control plane), storage engines, table formats, metadata/catalog services, and compaction/retention systems
Domain
Data Infrastructure / Distributed Systems / Open Source
Required skills
Distributed systems architecture, Table formats (Iceberg/Delta/Hudi), Query engines (Spark/Trino/Presto), Systems programming (Java/Scala/Go), Open-source contribution, Large-scale data systems design, Technical leadership, Incident response, Cost optimization
Preferred skills
MS/PhD in CS, Industry thought leadership, Cross-org technical initiative leadership, Catalog/metadata services expertise, Storage tiering strategies
Technologies
Apache Iceberg, Trino, Spark, OpenHouse, Java, Scala, Go
Responsibilities
Own technical roadmap and architecture for OpenHouse and core data lake services, Lead design of large-scale distributed systems for petabyte-scale Iceberg tables, Drive open-source contributions and ecosystem engagement, Partner with Analytics/AI teams on platform strategy, Provide technical mentorship and code review leadership, Evaluate emerging lakehouse technologies, Ensure system reliability and cost efficiency via SLOs and capacity planning, Lead technical design reviews and RFCs, Guide incident response and root-cause analysis
Seniority
Principal Staff, hands-on IC with heavy leadership
