CareerPlan

AI Benchmark Engineer | Native Language Specialist - Korean - Remote

Korea (Remote)RemoteFull-time2026-02-23 → 2026-11-20
RemoteNo visa sponsorship

Core

Design, build, and validate rigorous evaluation benchmarks (Terminal-Bench) to test large language models on multilingual software challenges and locale/encoding edge cases.

Role type

Senior IC AI Benchmark Engineer (Korean)

Builds

Verifiable evaluation suites and task environments for multilingual coding agents

Domain

AI evaluation, multilingual software engineering, terminal workflows

Deliverable

production ML models

Required skills

Python, shell scripting, data processing, terminal/CLI development, coding agents, multilingual text processing, Unicode normalization, locale conventions

Preferred skills

Native Korean fluency, deep understanding of Korean grammar/register, experience at leading tech companies, top-tier engineering university background

Technologies

Python, shell scripting, Terminal-Bench, Haiku, Sonnet, Opus

Responsibilities

Create high-signal tasks in native language, find AI failure points in native language, write deterministic verifier scripts, analyze execution logs, calibrate task difficulty, participate in 4-layer human quality control process

Seniority

Senior, hands-on IC