Software Engineer - GitHub Copilot API
Core
Design, develop, test, and ship high-quality technical solutions that scale across multiple GitHub services, focusing on LLM routing/orchestration capabilities and intelligent inference pathways.
Role type
Senior IC software engineer (LLM orchestration & API)
Builds
Scalable LLM routing/orchestration systems, APIs, and service components for GitHub Copilot integrations
Domain
Developer tools / AI infrastructure
Deliverable
production ML models
Required skills
LLM routing and orchestration, API design, system architecture, CI/CD, on-call management, technical mentorship, SLO definition, experiment design, production signal analysis
Preferred skills
Cloud native compute concepts, scripting languages, general purpose programming languages
Technologies
C, C++, C#, Java, JavaScript, Go, Ruby, Rust, Python, Bash
Responsibilities
Design and implement APIs and service components for Copilot integrations, build and evolve LLM routing/orchestration capabilities, write architecture briefs and proposals, run experiments/prototypes, mentor peers through technical leadership and code reviews, define and track success metrics including platform reliability metrics
Seniority
Senior, hands-on IC
