Senior Backend Engineer (Platform)
Core
Design and maintain internal LLM agent frameworks, backend services, and evaluation pipelines for speech technologies and generative AI products.
Role type
Senior Backend Engineer (Platform)
Builds
Scalable internal LLM agent framework, backend services, automated evaluation pipelines
Domain
Generative AI, Speech Technologies, NLP, Cloud-native architecture
Deliverable
production ML models
Required skills
Python, Async Python (FastAPI, aiohttp), System observability, Metrics, Tracing, Monitoring, Cloud-native architecture design, LLM agent framework development, LLM evaluation pipeline design
Preferred skills
AI Tracing Tools (LangSmith)
Responsibilities
Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism; Ensure system observability and reliability using metrics, tracing and monitoring tools; Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams; Build and support automated LLM evaluation pipelines; Design backend services using Python and modern cloud-native architecture.
Seniority
Senior, hands-on IC
