Senior Software Engineer, AI Infrastructure
Core
Design and build the platform for routing AI traffic and managing computing capacity.
Role type
Senior IC software engineer (AI infrastructure)
Builds
AI traffic routing systems and computing capacity management platforms
Domain
AI infrastructure and distributed systems
Deliverable
production ML models
Required skills
distributed systems design, traffic routing, resource allocation, C#, Java, Go, Python, Docker, Kubernetes, AI/ML infrastructure, model serving, GPU fleet management, on-call support, monitoring, security, privacy, compliance, AI tools in SDLC
Preferred skills
none stated
Technologies
C#, Java, Go, Python, Docker, Kubernetes
Responsibilities
Design key platform components for AI traffic routing and capacity management, write secure and tested code, conduct code reviews, break work into milestones with program managers, implement feature flags and gradual rollouts, participate in on-call rotation as DRI, add monitoring and dashboards, collaborate with product managers to translate user needs into technical requirements, integrate security and compliance into the development lifecycle, automate testing and releases, utilize AI tools across the SDLC
Seniority
Senior, hands-on IC
