Engineering Manager, AgentControl
Core
Lead the team building and operating offline evaluations, playgrounds, LLM-as-judges, and annotated datasets for the AgentControl product.
Role type
Engineering Manager (Backend/Infrastructure)
Builds
Services powering AI evaluations at scale, including web applications and distributed systems for agent control and monitoring.
Domain
SaaS / AI Infrastructure / Observability
Deliverable
production ML models
Required skills
Team leadership, roadmap planning, feature delivery, cross-team collaboration, stakeholder communication, hiring, operational excellence, incident response, observability practices, AI tooling familiarity, Go, Python
Preferred skills
Backend languages (Java, Rust, Ruby), common AI providers (Anthropic, OpenAI, Bedrock, Gemini), AI tooling (Langchain, Arize)
Technologies
Go, Python, Typescript, AWS, CockroachDB, Datadog
Responsibilities
Lead and develop a team of engineers, partner with PM and Design to scope roadmap items, own team delivery of features, collaborate on shared infrastructure decisions, communicate roadmaps and risks, build team working norms, drive operational excellence, participate in hiring
Seniority
Manager, hands-on leadership
