CareerPlan

Principal Staff Software Engineer - Data Lake Infrastructure

Mountain View, CA, usFull-time$231k2026-10-26 → 2026-11-22
Hybrid

Core

Design and operate OpenHouse, LinkedIn's open-source control plane for Apache Iceberg tables, and the broader data lake stack serving petabyte-scale datasets for analytics, ML, and AI workloads.

Role type

Principal Staff Software Engineer (Data Lake Infrastructure)

Builds

OpenHouse (Apache Iceberg control plane), storage engines, table formats, metadata/catalog services, and compaction/retention systems

Domain

Data Infrastructure / Distributed Systems / Open Source

Required skills

Distributed systems architecture, Table formats (Iceberg/Delta/Hudi), Query engines (Spark/Trino/Presto), Systems programming (Java/Scala/Go), Open-source contribution, Large-scale data systems design, Technical leadership, Incident response, Cost optimization

Preferred skills

MS/PhD in CS, Industry thought leadership, Cross-org technical initiative leadership, Catalog/metadata services expertise, Storage tiering strategies

Technologies

Apache Iceberg, Trino, Spark, OpenHouse, Java, Scala, Go

Responsibilities

Own technical roadmap and architecture for OpenHouse and core data lake services, Lead design of large-scale distributed systems for petabyte-scale Iceberg tables, Drive open-source contributions and ecosystem engagement, Partner with Analytics/AI teams on platform strategy, Provide technical mentorship and code review leadership, Evaluate emerging lakehouse technologies, Ensure system reliability and cost efficiency via SLOs and capacity planning, Lead technical design reviews and RFCs, Guide incident response and root-cause analysis

Seniority

Principal Staff, hands-on IC with heavy leadership