Senior Associate/Assistant Vice President, Agent Assurance Engineer (1365044257A4)
Core
Design and operate systems to verify, validate, and continuously monitor the behavior of Temasek's AI agents in production investment workflows.
Role type
Senior IC AI agent assurance and evaluation engineer
Builds
Agent harnesses, behavioral specifications, evaluation frameworks, and monitoring systems for AI agents
Domain
Enterprise AI / Investment Management
Deliverable
production ML models
Required skills
LLM evaluation frameworks, prompt engineering and context architecture, AI red-teaming and adversarial testing, AI system monitoring and observability, behavioral specification design, dynamic context management, prompt versioning and change management, automated evaluation suite design, red-team evaluation execution, user feedback mechanism design
Preferred skills
Experience in regulated or high-stakes environments, AI safety and alignment research (RLHF, constitutional AI, interpretability)
Technologies
Anthropic Claude, OpenAI APIs, LangChain, LangGraph, AutoGen, LangSmith Evals, RAGAS, DeepEval, LangFuse, Helicone, Weights & Biases
Responsibilities
Design and implement agent harnesses including system prompts, context injection patterns, tool permission scopes, and memory structures; Develop and maintain behavioral specifications for deployed agents; Engineer dynamic context management systems; Build and maintain prompt versioning and change management infrastructure; Design and operate evaluation frameworks for deployed agents; Build and maintain evaluation datasets with ground-truth labels; Run systematic red-team evaluations; Define and enforce evaluation gates within the AI product deployment pipeline; Partner with AI product teams to design user feedback mechanisms
Seniority
Senior, hands-on IC
