Software Engineer II
Core
Design and implement AI inference toolchains, observability pipelines, and management layers for on-premises AI infrastructure.
Role type
Senior IC software engineer (AI inference & observability)
Builds
Distributed AI inference services, model-serving platforms, telemetry systems, and policy enforcement gateways
Domain
Enterprise AI infrastructure, on-premises deployment, distributed systems
Deliverable
production ML models | infrastructure
Required skills
C#, C++, .NET, distributed system architecture, AI inference platforms (vLLM, SGLang, OpenVINO, Triton), model lifecycle management, API gateway design, observability pipelines, automated testing, server administration
Preferred skills
Operating system fundamentals, air-gapped environment deployment, AI orchestration layers
Technologies
vLLM, SGLang, OpenVINO, Triton, .NET, C++, C
Responsibilities
Design and develop distributed multi-tier service architectures for AI workloads; build observability pipelines using telemetry and diagnostics; define management layers for model lifecycles and catalogs; implement validation plans for infrastructure quality; coordinate with security teams for compliance.
Seniority
Senior, hands-on IC
