AI Engineer
Core
Implement AI platforms and services including inference stacks, AI gateways, RAG, and agent systems for customers running production LLM services.
Role type
Senior IC AI Engineer (LLM Infrastructure)
Builds
Production LLM inference services, AI gateways, RAG pipelines, and agentic workflows
Domain
Cloud Infrastructure / Generative AI
Deliverable
production ML models
Required skills
Python, Kubernetes, GPU workload management, LLM inference servers (vLLM, TensorRT-LLM, Triton), Linux, Cloud platforms (AWS/GCP/Azure), LLM application patterns
Preferred skills
AI gateway tooling, Vector databases, Model fine-tuning and optimization, GPU partitioning, Observability stacks, Infrastructure as Code
Technologies
Kubernetes, Helm, GitOps, Python, vLLM, TensorRT-LLM, Triton, OpenTelemetry, Prometheus, Grafana, Datadog, Terraform, Ansible
Responsibilities
Deploy and operate LLM inference services on Kubernetes and bare metal GPU clusters; Build and operate AI gateway and routing layers; Implement RAG pipelines and agentic workflows; Write production-quality services and automation; Instrument AI services for observability; Run benchmarks and load tests; Integrate AI services with customer identity and security systems; Document deployments and hand over runbooks
Seniority
Senior, hands-on IC