Staff / Senior Software Engineer (Agentic Search) - Index
Core
Building large-scale indexing systems and data pipelines for an agent-native search platform that serves AI systems.
Role type
Senior Software Engineer (Data Infrastructure)
Builds
Offline and nearline data pipelines, indexing systems, and storage formats for AI agent search
Domain
Cloud Infrastructure / AI / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Go, distributed systems, fault tolerance, scalability, data pipeline design, storage systems, observability, high-throughput system design
Preferred skills
C++/Rust, Spark/Flink/MapReduce/Beam, content systems (scraping/proxying), DBMS internals, open-source contributions
Technologies
Go, C++, Rust, Spark, Flink, MapReduce, Beam, cloud infrastructure
Responsibilities
Design and implement large-scale indexing systems and data pipelines; optimize indexing strategies for performance and freshness; manage storage formats and compaction strategies; ensure pipeline reliability under high throughput; build well-tested components with clear contracts; define observability primitives (logs, metrics, data quality); monitor throughput and resource usage; collaborate with runtime and ML teams; enable safe experimentation on indexing logic
Seniority
Senior, hands-on IC
