AI Benchmark Engineer | Native Language Specialist - Spanish (Argentina) - Remote
Core
Design, build, and validate rigorous evaluation benchmarks (Terminal-Bench) to test large language models on multilingual software challenges and terminal workflows.
Role type
Native language specialist / AI benchmark engineer (freelance)
Builds
High-signal multilingual task environments, datasets, and deterministic verifier scripts for AI model evaluation.
Domain
Artificial Intelligence / Large Language Models / Multilingual Software Engineering
Deliverable
production ML models
Required skills
Python, shell scripting, data processing, terminal/CLI development, coding agents, multilingual text processing, Unicode normalization, locale-dependent conventions
Preferred skills
Experience at leading technology companies, top-tier engineering university graduation, deep understanding of native language grammar and register
Technologies
Python, shell scripting, Terminal-Bench, Haiku, Sonnet, Opus
Responsibilities
Create realistic task environments in native language, find failure points in AI models, write reliable verifier scripts, analyze execution logs, calibrate task difficulty, participate in human quality control processes
Seniority
Mid-level, hands-on IC