Software Engineer, AI Agent & LLM
Core
Build and improve AI systems for Otter's conversational knowledge engine and AI Chat, focusing on user-facing agent experiences, evaluation systems, and shared platform infrastructure.
Role type
Senior hands-on IC AI Agent & LLM Engineer
Builds
AI-agent experiences, conversational knowledge engine, evaluation datasets, automated graders, regression tests, release gates, and shared agent infrastructure
Domain
AI/ML, conversational AI, knowledge retrieval, distributed systems
Deliverable
production ML models | product features | infrastructure
Required skills
AI Agent engineering, machine learning engineering, backend engineering, distributed systems, AI quality evaluation, nondeterministic system evaluation, data analysis, failure diagnosis, product judgment, engineering rigor
Preferred skills
coding agents usage, quality control of AI-generated code
Technologies
LLMs, AI agents, evaluation frameworks, tracing, observability tools
Responsibilities
Build AI-agent experiences for Otter AI Chat; Advance conversational knowledge engine via knowledge extraction and indexing; Develop robust evaluation datasets and automated graders; Diagnose failures across models, prompts, retrieval, and data pipelines; Build shared agent infrastructure for orchestration and debugging; Improve task completion, correctness, reliability, latency, and cost; Collaborate across AI, product, infrastructure, data, security, and application teams
Seniority
Senior, hands-on IC
