CareerPlanGet AI match score →

Senior Staff Engineer (LLM)

💼 Full-time🗓 2026-07-21 → 2026-07-31

Core

Build and ship LLM-powered features in a complex, production application used at scale, spanning backend services, APIs, and LLM systems (retrieval, agents, evaluation).

Role type

Senior Staff Engineer (LLM)

Builds

LLM-powered features, backend services, APIs, and LLM systems for a complex production application.

Domain

Generative AI, Large Language Models, Backend Engineering

Deliverable

production ML models

Required skills

Python, FastAPI, LLM Application Frameworks, Vector Databases and Embeddings, RAG system design, multi-agent systems, server-side events, event-driven architectures, MCP servers, prompt engineering, LLM model APIs (OpenAI, Anthropic), AI-assisted coding tools, agentic coding tools, autonomous coding agents, security best practices for backend systems, debugging complex backend systems, systems-level thinking.

Preferred skills

LLM guardrails, LLM monitoring and observability, LLM evaluation harnesses, LLM-as-judge, offline/online quality metrics.

Technologies

FastAPI, OpenAI, Anthropic, LangChain, LlamaIndex, vector databases, MCP servers, Claude Code, Cursor, GitHub Copilot.

Responsibilities

Write and refactor code using AI-assisted and agentic coding tools, build REST APIs, design and implement RAG systems end to end, develop and deploy generative solutions to production at scale, collaborate with Product Owners and stakeholders to solve complex problems, take full ownership of features and projects.

Seniority

Senior Staff, hands-on IC

Sourced via smartrecruiters · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on SmartRecruiters ↗