Staff Software Engineer - Ingestion
Core
Design and build scalable data ingestion systems (Lakeflow Connect) to extract data from OLTP systems, databases, and cloud storage with minimal production load.
Role type
Staff Software Engineer (Ingestion Systems)
Builds
Point-and-click connectors for enterprise applications, databases, and cloud storage; scalable ingestion engine for the Lakehouse platform.
Domain
Data Engineering / Distributed Systems / Database Internals
Deliverable
production ML models | product features | infrastructure
Required skills
Database internals, Database replication, Transaction recovery, Log parsing, Incremental data capture, Large-scale distributed systems, Algorithms and data structures, Low-level systems debugging, Performance optimization
Preferred skills
Experience with major database vendors (Microsoft SQL Server, Oracle, IBM), Multi-year vision planning, Customer value delivery
Technologies
SQL Server, Oracle, IBM, Apache Spark, Delta Lake
Responsibilities
Build architecture design and influence product roadmap for ingestion capabilities; Lead complicated technical projects across multiple teams; Mentor team members and lead sprint planning; Investigate and prevent production issues on large clusters; De-risk complex problems through prototyping and validation.
Seniority
Staff, hands-on IC with technical leadership
