Staff / Senior Software Engineer (Agentic Search) - Index
Core
Building the indexing and data processing layer for an agent-native search platform that provides low-latency, observable search APIs for AI systems.
Role type
Senior Software Engineer (Data Infrastructure)
Builds
Large-scale indexing systems, data pipelines, and storage formats for petabyte-scale datasets.
Domain
Cloud Infrastructure / AI / Distributed Systems
Deliverable
production ML models
Required skills
Go, distributed systems, fault tolerance, scalability, database internals, data pipeline design, observability, systems thinking
Preferred skills
C++/Rust, Spark/Flink/MapReduce/Beam, content systems (scraping/proxying), DBMS internals, open-source contributions, competitive programming
Technologies
Go, C++, Rust, Spark, Flink, MapReduce, Beam
Responsibilities
Design and operate large-scale indexing systems and data pipelines; develop and optimize indexing strategies; work on storage formats and compaction strategies; ensure pipeline reliability under high throughput; build well-tested components; define observability primitives; monitor throughput and resource usage; collaborate with runtime and ML teams; enable safe experimentation on indexing strategies.
Seniority
Senior, hands-on IC
