Senior Software Engineer - Ingestion
Core
Building and operating the Lakeflow Connect platform to ingest data from diverse sources (enterprise apps, databases, cloud storage) into the Databricks Lakehouse with minimal impact on production systems.
Role type
Senior Software Engineer - Ingestion (Database Internals)
Builds
Lakeflow Connect connectors and ingestion engine for the Databricks Data Intelligence Platform
Domain
Data Infrastructure / Database Internals / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Python, Java, Scala, C++, large-scale distributed systems, database replication, transaction recovery, backend systems development, performance optimization
Preferred skills
Experience with Microsoft SQL Server, Oracle, IBM databases
Technologies
Python, Java, Scala, C++, SQL Server, Oracle, IBM
Responsibilities
Design and build scalable, fault-tolerant data ingestion engines; optimize low-level system performance on large clusters; debug production issues; lead complex technical projects across teams; define architecture and product roadmap for ingestion capabilities.
Seniority
Senior, hands-on IC
