Principal Software Engineer
Core
Architect and build scalable platforms for agentic evaluation, production audits, and human-in-the-loop review where AI agents assist reviewers with evidence gathering and decision analysis.
Role type
Principal Software Engineer (AI Evaluation & Orchestration)
Builds
Distributed orchestration systems for long-running workflows involving models, agents, tools, automated checks, and human decisions.
Domain
AI/ML, Agent Orchestration, Human-in-the-loop systems, High-scale decision domains
Deliverable
production ML models | infrastructure
Required skills
System design, Distributed systems architecture, Workflow orchestration, Event-driven systems, Service reliability, Production coding (C++, C#, Java, Python, or TypeScript), AI evaluation platform design, LLMOps
Preferred skills
Experience in advertising, trust and safety, fraud, responsible AI, search, or recommendations
Technologies
C++, C#, Java, Python, TypeScript
Responsibilities
Design distributed orchestration systems for long-running workflows, Build reviewer experiences presenting evidence and uncertainty, Provide technical leadership across engineering, science, product, design, operations, and policy teams, Own substantial systems from initial architecture through production operations
Seniority
Principal, hands-on IC with strategic leadership