LLM Agent基础架构工程师-TRAE
Core
Design and build the core backend infrastructure for TRAE, an AI coding agent that enables end-to-end software development within an IDE.
Role type
Senior IC LLM Agent Infrastructure Engineer
Builds
AI IDE/Coding Agent backend systems, model orchestration platforms, and agent runtime infrastructure
Domain
AI Software Development / LLM Engineering
Deliverable
production ML models
Required skills
Golang, Java, Python, C++, high-concurrency system design, LLM API engineering, agent loop optimization, streaming response handling, cost optimization, observability
Preferred skills
AI IDE/Coding Agent experience, LLM Gateway, Agent Runtime, Prompt management, experimental platforms, commercial billing systems
Technologies
Golang, Java, Python, C++, LLM APIs, caching, queues, async tasks, rate limiting, circuit breakers, tracing
Responsibilities
Develop core backend systems for code completion, understanding, generation, and test execution; Build model access and scheduling infrastructure including routing and function calling; Construct engineering infrastructure for agent runtime, context management, and evaluation; Optimize system performance for low-latency high-frequency requests and long-running agent tasks
Seniority
Senior, hands-on IC
