Software Engineer - Database Engine Internals
Core
Design next-generation decoupled query engines and structured storage systems to outperform specialized data warehouses while supporting diverse workloads from ETL to data science.
Role type
Senior IC database systems engineer (query engine & storage internals)
Builds
Next-generation Lakehouse query engine and structured storage system
Domain
Data infrastructure, distributed systems, database internals
Deliverable
production ML models | product features
Required skills
Query compilation and optimization, distributed query execution and scheduling, vectorized execution engine design, data security, resource management, transaction coordination, efficient storage structures (encodings, indexes), automatic physical data optimization
Preferred skills
PhD in databases or distributed systems
Technologies
Apache Spark, Delta Lake
Responsibilities
Drive requirements clarity and design decisions for ambiguous problems, Produce technical design documents and project plans, Develop new features, Mentor more junior engineers, Test and rollout to production with monitoring
