Senior Staff Software Engineer - Lakeflow Pipelines Datasets
Core
Architect and lead the engineering of a massive distributed data platform (ETL, streaming, materialized views) serving thousands of customers, solving frontier problems in fault-tolerant incremental computation and stream-batch unification.
Role type
Senior Staff Software Engineer (Technical Architect & Engineering Leader)
Builds
Declarative Dataflow Graphs, Materialized Views, Structured Streaming, and Flows at exabyte scale
Domain
Distributed systems, Data Engineering, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
distributed systems architecture, database internals, storage systems, streaming systems, performance engineering, algorithmic foundations, multi-year technical vision execution
Preferred skills
bridging research to production, low-level debugging, cross-team initiative leadership
Technologies
Apache Spark, Delta Lake, Lakehouse
Responsibilities
Define long-term technical direction for pipeline execution and optimization; design and build next-gen data infrastructure; translate ambiguous large-scale challenges into incremental execution plans; lead deep systems work including performance diagnosis and cost/latency optimization; shape product direction alongside leadership; drive complex multi-team technical initiatives
Seniority
Senior Staff, hands-on IC with significant mentorship and strategy scope
