Senior Software Engineer
Core
Building AI evaluation frameworks, scaling inference pipelines, and managing large-scale compute orchestration to ensure system health and efficiency.
Role type
Senior Software Engineer (AI Infrastructure & Evaluation)
Builds
AI evaluation benchmarks, high-throughput inference pipelines, and distributed compute orchestration systems
Domain
Artificial Intelligence / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
C, C++, C#, Java, JavaScript, Python, distributed systems design, cloud service backend operations, CI/CD automation, compute capacity management, cost modeling
Preferred skills
Experience with AI agent or LLM-based systems at production scale
Technologies
Azure DevOps (ADO), CI/CD pipelines
Responsibilities
Building AI evals and benchmarks to monitor system health and prevent regression; Scaling pipelines by an order of magnitude to improve throughput and reliability; Managing compute and AI infrastructure at Windows-wide scale including queuing, scheduling, and pool prioritization; Driving billing estimation and cost-of-goods modeling
Seniority
Senior, hands-on IC
