CareerPlanSign in

Senior/Staff Software Engineer, Search & Retrieval Infrastructure

New York City💼 Full-time🗓 2026-08-05 → 2026-09-27

Core

Design and build core components of next-generation search and retrieval infrastructure powering high-quality, scalable agentic systems and LLM-powered applications.

Role type

Senior/Staff Software Engineer (Search & Retrieval Infrastructure)

Builds

Frameworks for knowledge synthesis, semantic/hybrid retrieval, indexing pipelines, and retrieval orchestration for enterprise-grade AI applications.

Domain

AI Infrastructure / Distributed Systems / Vector Databases

Deliverable

production ML models | product features | infrastructure

Required skills

Backend system architecture, distributed systems design, high-throughput indexing pipelines, semantic search, hybrid retrieval strategies, RAG patterns, query planning, API design, observability frameworks, infrastructure-as-code

Preferred skills

Multi-tenant SaaS platform experience, retrieval evaluation frameworks, agentic reasoning loops

Technologies

Go, Rust, C++, Java, Python, Kubernetes, Terraform, Pulumi, Elastic, OpenSearch

Responsibilities

Design scalable platform components leveraging advanced retrieval via query planning and hybrid search; Build optimized indexing pipelines for structured and unstructured data; Build backend services for semantic retrieval and knowledge graph construction; Improve retrieval quality through evaluation and observability frameworks; Design APIs for internal and external agentic consumers; Optimize latency, throughput, and cost across large-scale inference workloads; Drive technical direction for reliability and security.

Sourced via ashby · Listed on CareerPlan, which tracks 814,000+ jobs from 20+ sources.