Staff Software Engineer - Query Planner & Reflections
Core
Setting technical direction for the SQL planner and optimizer (Query Planner & Reflections) in a unified lakehouse platform.
Role type
Staff Software Engineer (Query Planning & Optimization)
Builds
SQL planner, optimizer, and reflections substitution engine for cloud, hybrid, and on-prem lakehouses.
Domain
Data Engineering / Distributed Systems / Query Optimization
Deliverable
production ML models | product features
Required skills
Query planning and optimization, Apache Calcite, Apache Iceberg, Java, C++, SQL, distributed file systems (S3, ADLS, HDFS), cloud platforms (AWS, Azure, GCP), system-level architecture, cross-team initiative leadership.
Preferred skills
Distributed query engines, query processing, materialized view matching, concurrency control, code generation, Apache Arrow, caching, disk spilling, open-source contributions.
Technologies
Apache Calcite, Apache Iceberg, Apache Arrow, Java, C++, AWS, Azure, GCP, S3, ADLS, HDFS.
Responsibilities
Set architecture and technical direction for the Query Planner and Reflections team; own design, implementation, and delivery of complex cross-team initiatives; diagnose correctness and performance issues using query profiles and telemetry; use AI-assisted development tools for code comprehension and debugging; design architectures for multiple deployment models; participate in design and code reviews; partner with Product and Support teams.
Seniority
Staff, hands-on IC with strategic direction


