Software Engineering Manager - Build Agent
Core
Lead the team responsible for the Build Agent evaluation framework, model support, and telemetry to ensure the AI coding assistant's correctness, latency, and cost efficiency.
Role type
Senior Engineering Manager (AI/LLM Evaluation)
Builds
ServiceNow's Build Agent AI coding assistant
Domain
Enterprise IT automation / AI coding agents
Deliverable
production ML models | product features
Required skills
LLM evaluation system design, cross-team accountability without direct authority, coding agent architecture, foundation model benchmarking, people management, ambiguous problem solving
Preferred skills
Managing 8+ engineers, managing managers
Technologies
Java, C++, Ruby, Shell, JavaScript
Responsibilities
Own eval strategy and roadmap, coordinate cross-team quality standards, lead model benchmarking efforts, manage daily activities of an 8-engineer team, solve ambiguous cross-cutting problems, represent eval results to stakeholders
Seniority
Senior, hands-on IC with management responsibilities