Engineering Manager, Agent Oversight
Core
Lead the team building a platform for monitoring, evaluating, and improving agentic applications for enterprise and government customers.
Role type
Engineering Manager, Agent Oversight
Builds
Platform for monitoring, evaluation, and ML-driven improvement of agentic applications
Domain
Generative AI, Agentic Systems, Enterprise & Government
Deliverable
production ML models
Required skills
Engineering management, Agent architecture design, ML evaluation methodology, Platform lifecycle ownership, Cross-functional collaboration, Team building and scaling
Preferred skills
ML/LLM observability, Full ML lifecycle expertise, LLM system design, Published research in agentic systems
Technologies
LLMs, Agent frameworks, Monitoring tools, Evaluation platforms
Responsibilities
Lead multi-disciplinary team of software and ML engineers, Own platform roadmap for deployment and evaluation, Translate customer requirements into platform capabilities, Build and ship features end-to-end, Drive high-velocity experimentation, Establish technical direction and culture, Mentor engineers and ML scientists
