Machine Learning Engineer, AI Labs
Core
Building and optimizing enterprise-scale LLM inference systems and AI/ML solutions for cloud security.
Role type
Senior Machine Learning Engineer (LLM Inference)
Builds
High-throughput LLM serving infrastructures and production-grade AI systems for the Netskope SSE platform.
Domain
Cloud Security / AI / Distributed Systems
Deliverable
production ML models
Required skills
LLM inference optimization, distributed systems architecture, vLLM, SGLang, TensorRT-LLM, KV Cache optimization, Python, system design
Preferred skills
Advanced technical degree, experience with memory management techniques
Technologies
vLLM, SGLang, TensorRT-LLM
Responsibilities
Design and deploy enterprise-scale LLM serving infrastructures, drive execution of critical AI/ML technical strategies, translate business requirements into deployed code, implement and scale production model performance tracking.
Seniority
Senior, hands-on IC
