Staff Machine Learning Engineer, AI Applications, Berlin
Core
Lead the quality, learning, and knowledge foundations for Bolt's AI automation stack in customer support, focusing on LLM alignment, knowledge retrieval, and continuous improvement of conversational experiences.
Role type
Staff Machine Learning Engineer (AI Applications)
Builds
AI automation stack for customer support, including LLM-based systems, knowledge retrieval, and feedback loops.
Domain
Customer Support / AI / Knowledge Systems
Deliverable
production ML models
Required skills
Retrieval-augmented systems, search, ranking, knowledge-based AI applications, LLM pipelines, agentic AI systems, tool use, routing, memory, multi-step reasoning, human-AI orchestration, evaluation strategy, offline benchmarks, golden datasets, human review workflows, online experimentation, production quality metrics, feedback loops, data analysis, failure analysis, cross-language engineering
Preferred skills
Experience in knowledge-heavy or policy-constrained domains, experience with Node.js (not required but mentioned as a tool), experience with LLM-based pipelines or agentic AI systems
Technologies
LLMs, retrieval systems, search engines, ranking algorithms, knowledge graphs, data pipelines, experimentation frameworks
Responsibilities
Align Customer Support AI system behaviour to business goals and policy requirements, build and scale knowledge mining capabilities, own the evaluation strategy for LLM-powered systems, develop feedback loops connecting production failures to system improvements, partner with engineers on AI application infrastructure, influence roadmap and technical direction across teams
Seniority
Staff, strategic direction & hands-on execution