Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Core
Design, build, and optimize AI infrastructure for real-time inference, evaluation, and deployment of computer vision, LLM, and multimodal models across terabytes of video data.
Role type
Senior IC AI Infrastructure Engineer (Inference & Evaluation)
Builds
Scalable inference systems, evaluation harnesses, and data engines for production AI models
Domain
Physical security / Computer Vision / Large Language Models / Multimodal AI
Deliverable
production ML models
Required skills
Python, distributed systems, inference optimization, GPU utilization, model serving frameworks, evaluation harnesses, cloud infrastructure, containers, orchestration
Preferred skills
CUDA, NCCL, PyTorch, TensorRT, ONNX, video understanding, model compression, RAG, vector databases
Technologies
vLLM, Triton Inference Server, PyTorch, CUDA, NCCL, TensorRT, ONNX
Responsibilities
Design and maintain AI infrastructure for real-time inference workloads; Build scalable systems for running state-of-the-art models on large video data; Optimize inference performance for latency, throughput, and cost; Develop evaluation harnesses and benchmarking systems; Build infrastructure for continuous model evaluation and deployment; Partner with research scientists to productionize AI advances; Improve model-serving architecture including batching, caching, and quantization; Create observability and debugging tools for production AI systems.
Seniority
Senior, hands-on IC
