Subject Matter Expert – Qualtative/Scientific/Corporate (English/Mandarin) – Remote
Core
Design realistic scenarios, adapt evaluation rubrics, and review AI/human responses for factual accuracy and operational realism in specific professional domains (Technical, Scientific, or Corporate) to support AI benchmarking.
Role type
Independent contractor Subject Matter Expert (SME) / AI Engineer
Builds
Gold standard solutions and localized evaluation datasets for AI benchmarking projects
Domain
AI benchmarking across Technical (Software Eng., Robotics), Scientific (Healthcare, Natural Science, Manufacturing), and Corporate (Finance, Media) verticals
Deliverable
production ML models
Required skills
Native-level fluency in target language, professional English proficiency, domain expertise (Software Eng., Math, Robotics, Healthcare, Natural Science, Manufacturing, Finance, Media), code execution verification in sandboxed environments, rubric adaptation, cultural appropriateness assessment
Preferred skills
Background in relevant domain positions, deep understanding of domain workflows
Technologies
Sandbox environments, AI benchmarking tools