Senior Staff Software Engineer - Lakeflow Pipelines Datasets
Core
Architect and lead the engineering of the Lakeflow ETL platform, designing scalable data pipelines, materialized views, and stream processing systems for exabyte-scale data.
Role type
Senior Staff Software Engineer (Technical Architect & Engineering Lead)
Builds
Declarative Dataflow Graphs, Materialized Views, Structured Streaming, and Flows
Domain
Distributed Data Systems / Big Data Infrastructure
Required skills
distributed systems architecture, database internals, storage systems, stream processing, performance engineering, algorithmic foundations, multi-year technical vision execution
Preferred skills
bridging research to production, cross-team initiative leadership, customer-impact bias
Technologies
Apache Spark, Delta Lake, Lakehouse
Responsibilities
Define long-term technical direction for pipeline execution and optimization; design next-generation data infrastructure; lead deep systems work including performance diagnosis and low-level debugging; shape product direction alongside leadership; drive complex multi-team technical initiatives.
Seniority
Senior Staff, hands-on IC with strategic leadership