Senior Research Engineer (Agentic Behavior) (m/f/d)
Core
Build evaluation infrastructure, error analysis tools, and post-training pipelines to measure and improve AI coding agents' behavior on Kotlin code.
Role type
Senior Research Engineer (Agentic Behavior)
Builds
Evaluation pipelines, observability tools, simulation environments, and open-source benchmarks for AI coding agents.
Domain
AI/ML, Software Development Tools, Kotlin Ecosystem
Required skills
Python engineering, LLM evaluation pipeline design, data analysis at scale, end-to-end project ownership, product-aware mindset, Kotlin familiarity
Preferred skills
Post-training techniques (SFT, DPO, GRPO), PyTorch, LLM training stacks, AI agent development, experiment tracking tools, Kotlin ecosystem depth, open-source contributions
Technologies
Python, SQL, Athena, PyTorch, TRL, verl, Megatron, Inspect AI, Promptfoo, LM-evaluation-harness, W&B, MLflow, Langfuse, Gradle, Spring, Ktor, Android, KMP
Responsibilities
Design and implement tooling to capture and analyze AI agent errors; Build observability pipelines over agentic traces; Design and maintain evaluation pipelines for code generation quality; Experiment with post-training techniques to improve model behavior; Build public open-source benchmarks for Kotlin tasks.
Seniority
Senior, hands-on IC
