CareerPlanGet AI match score →

Senior/Staff Software Engineer, Search & Retrieval Infrastructure

US Remote💼 Full-time🗓 2026-03-23 → 2026-07-31

Core

Design and build core components of next-generation knowledge retrieval infrastructure (search and retrieval) powering high-quality, scalable agentic systems and LLM-powered applications.

Role type

Senior/Staff Software Engineer (Search & Retrieval Infrastructure)

Builds

Frameworks for connecting synthesized knowledge to modern LLM applications, optimized indexing pipelines, and backend services for semantic/hybrid retrieval.

Domain

AI Infrastructure / Vector Databases / Distributed Systems

Deliverable

production ML models | infrastructure

Required skills

Backend system architecture, distributed systems, semantic search, hybrid retrieval strategies, RAG patterns, query planning, metadata filtering, high-throughput indexing, API design, observability, latency optimization, Go/Rust/C++/Java/Python, Kubernetes, Terraform/Pulumi

Preferred skills

Multi-tenant SaaS platform experience, retrieval evaluation frameworks, agentic reasoning loops

Technologies

Kubernetes, Terraform, Pulumi, Elastic, OpenSearch

Responsibilities

Design scalable platform components leveraging advanced retrieval via query planning and hybrid search; Build optimized indexing pipelines for structured and unstructured data; Build backend services for semantic retrieval and knowledge graph construction; Improve retrieval quality through evaluation and observability frameworks; Design APIs for internal and external user and agentic consumers; Optimize latency, throughput and cost across large-scale inference and retrieval workloads; Drive technical direction for reliability and security

Seniority

Senior/Staff, hands-on IC with significant ownership

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Ashby ↗