Senior Software Engineer, AI Agents & Evals
Core
Building and evolving production agent infrastructure, including orchestration layers, middleware stacks, and evaluation suites for enterprise SQL generation and data analysis.
Role type
Senior IC software engineer (AI agents & evals)
Builds
Agent orchestration harness, middleware stack, typed handoff contracts, structured eval suites, and production reliability tooling.
Domain
Enterprise data analytics, LLM agent systems, and production software engineering.
Deliverable
production ML models | product features | infrastructure
Required skills
Python, LLM-based systems, agent loops, tool use, context management, inference pipelines, LangGraph, LangChain, OpenAI/Anthropic tool-use, eval engineering, strict typing, contract tests, CI discipline, production debugging, systems thinking.
Preferred skills
HITL workflow design, context engineering, LangSmith, Weights and Biases, SQL/data correctness, mypy, Pydantic contracts.
Technologies
LangGraph, LangChain, OpenAI, Anthropic, LangSmith, Python, TypeScript, SQL.
Responsibilities
Own the harness architecture and middleware stack; maintain typed contracts and boundaries; own the eval suites; triage production failures and close the loop; own SQL and artifact correctness; build and maintain HITL workflows; instrument for traceability.
Seniority
Senior, hands-on IC