Senior AI Application Engineer
Core
Design, build, and scale production-grade LLM integrations and AI-powered automation tools for internal employee workflows.
Role type
Senior full-stack AI application engineer
Builds
Internal automation, knowledge retrieval, and intelligent workflow assistance tools for Klaviyo employees
Domain
Ecommerce technology / Applied AI
Deliverable
production ML models | product features
Required skills
Large language model integration (OpenAI, Anthropic, Mistral, Llama), full-stack engineering (Python, TypeScript/JavaScript), CI/CD pipeline design, RAG system architecture, vector databases, cloud infrastructure (AWS/GCP/Azure), containerization, prompt engineering, LLM observability
Preferred skills
Model fine-tuning, A/B testing infrastructure, infrastructure-as-code
Technologies
FastAPI, Flask, Django, GitHub Actions, Jenkins, CircleCI, Pinecone, Weaviate, pgvector, Docker, Kubernetes, Terraform, Pulumi, LangSmith, Weights and Biases
Responsibilities
Architect and develop production-grade LLM systems; Design robust API integrations between AI models and internal systems; Own end-to-end development of AI features from backend to frontend; Build and maintain automated deployment pipelines for AI models; Design and build retrieval-augmented generation systems; Lead benchmarking, evaluation, and fine-tuning of foundation models; Define coding standards and architectural patterns for AI development; Instrument AI systems with monitoring and quality evaluation tools; Collaborate with Product and Data Science teams; Ensure AI integrations follow data privacy and security best practices
Seniority
Senior, hands-on IC
