Senior Software Engineer- AI Frameworks
Core
Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, and performance tooling.
Role type
Senior IC software engineer (AI frameworks & performance)
Builds
AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations
Domain
Artificial Intelligence / High-performance computing
Deliverable
production ML models
Required skills
C++, Python, GPU programming, kernel optimization (CUDA, Triton), profiling, benchmarking, memory hierarchy management, parallel execution, synchronization, hardware utilization, inference frameworks (vLLM, SGLang), model execution, scheduling, batching, KV-cache mechanisms
Preferred skills
AI-assisted development tools
Technologies
CUDA, Triton, vLLM, SGLang
Responsibilities
Design and implement production-quality components across AI frameworks and runtimes; Build automation and observability to detect regressions and improve reproducibility; Drive scoped projects from problem definition through deployment; Partner with researchers and infrastructure owners to diagnose cross-stack issues; Contribute to technical design reviews and mentoring of other engineers
Seniority
Senior, hands-on IC