CareerPlan

AI Engineer - LLM Adoption Department (LLMAD)

Tokyo, JapanFull-time2026-08-20 → 2026-11-13

Core

Build and embed agentic workflows and integrations for in-house LLMs within business units, replacing third-party alternatives.

Role type

Senior IC AI Engineer (LLM adoption & agentic workflows)

Builds

Production agent workflows, tool-use integrations, and prompt-based features for business units

Domain

AI / Large Language Models / Enterprise Software

Deliverable

production ML models

Required skills

Agentic engineering (function calling, orchestration), Prompt engineering, Python, API integration, Backend services, Unit testing, Debugging, Latency optimization, Cost optimization, Evaluation harness design

Preferred skills

Retrieval-augmented generation (RAG), LLM observability, Self-hosted inference (vLLM), Cloud model deployment

Technologies

Python, vLLM, Open-source LLMs

Responsibilities

Implement agent and tool-use workflows (function calling, multi-step flows, retrieval, guardrails) in business unit codebases; Debug production failures and optimize latency/cost; Run task-level evaluations and maintain eval sets; Design and iterate prompts, output schemas, and tool definitions; Support migrations from third-party APIs to in-house models; Document reusable recipes and templates for team adoption

Seniority

Mid-Senior, hands-on IC