Senior AI Developer
Core
Design, build, and own ClickUp's AI evaluation system, core agent harness, and scalable backend services for LLMs to measure and improve AI quality.
Role type
Senior IC AI Engineer (Evaluations & Platform)
Builds
AI evaluation systems, agent harness, scalable backend services, and model serving infrastructure
Domain
SaaS productivity tools + Large Language Models (LLMs)
Deliverable
production ML models
Required skills
LLM evaluation systems, backend engineering, distributed systems, Python, Go, TypeScript, Kubernetes, Docker, AWS/GCP/Azure, orchestration frameworks (LangGraph, Airflow, Ray), model routing/benchmarking
Preferred skills
Data science background, eval tooling (Braintrust, LangSmith), inference optimization
Technologies
Python, Go, TypeScript, Kubernetes, Docker, AWS, GCP, Azure, LangGraph, Airflow, Ray, OpenAI, Anthropic, Google
Responsibilities
Design and build AI evaluation systems with golden datasets and automated scorers; Build and evolve the core agent harness; Architect scalable AI platform services for LLM deployment; Develop robust APIs and backend systems; Develop infrastructure for model serving and monitoring; Drive best practices in AI privacy and security
Seniority
Senior, hands-on IC
