CareerPlan

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Redwood CityFull-time2026-09-10 → 2026-11-19
Hybrid · United States

Core

Design, build, and optimize AI infrastructure for real-time inference, evaluation, and deployment of computer vision, LLM, and multimodal models across terabytes of video data.

Role type

Senior IC AI Infrastructure Engineer (Inference & Evaluation)

Builds

Scalable inference systems, evaluation harnesses, and data engines for production AI models

Domain

Physical security / Computer Vision / Large Language Models / Multimodal AI

Deliverable

production ML models

Required skills

Python, distributed systems, inference optimization, GPU utilization, model serving frameworks, evaluation harnesses, cloud infrastructure, containers, orchestration

Preferred skills

CUDA, NCCL, PyTorch, TensorRT, ONNX, video understanding, model compression, RAG, vector databases

Technologies

vLLM, Triton Inference Server, PyTorch, CUDA, NCCL, TensorRT, ONNX

Responsibilities

Design and maintain AI infrastructure for real-time inference workloads; Build scalable systems for running state-of-the-art models on large video data; Optimize inference performance for latency, throughput, and cost; Develop evaluation harnesses and benchmarking systems; Build infrastructure for continuous model evaluation and deployment; Partner with research scientists to productionize AI advances; Improve model-serving architecture including batching, caching, and quantization; Create observability and debugging tools for production AI systems.

Seniority

Senior, hands-on IC