Staff Software Engineer - Ingestion
Core
Building and operating scalable data ingestion engines (Lakeflow Connect) to extract data from OLTP systems and enterprise sources with minimal production load, serving thousands of customers across Databricks surfaces.
Role type
Staff Software Engineer (Ingestion Systems)
Builds
High-scale, fault-tolerant data ingestion engines and connectors for enterprise applications, databases, and cloud storage.
Domain
Data Engineering / Distributed Systems / Database Internals
Deliverable
production ML models | infrastructure
Required skills
Large-scale distributed systems architecture, Database internals (replication, backup, transaction recovery), Log parsing, Incremental data capture, Low-level systems debugging, Performance optimization, Algorithms and data structures, Technical leadership, Mentoring
Preferred skills
Experience with major database vendors (Microsoft SQL Server, Oracle, IBM), Multi-year vision planning, Customer value delivery
Technologies
SQL Server, Oracle, IBM, Enterprise applications (Salesforce, Workday, ServiceNow, SharePoint), Cloud storage, Message queues
Responsibilities
Design and build scalable ingestion systems processing hundreds of TB of data daily, Debug and optimize large production clusters, Lead technical projects and influence product roadmap, Mentor team members and lead sprint planning, Investigate and resolve production issues, De-risk complex problems through prototyping
Seniority
Staff, hands-on IC with technical leadership
