Expert Coding Raters
Core
Evaluate AI model responses containing code and ML outputs for quality, correctness, and adherence to standards; annotate code snippets and validate datasets for model training.
Role type
AI model quality rater (coding focus)
Builds
Production ML models | product features
Domain
Artificial Intelligence / Machine Learning / Software Engineering
Deliverable
production ML models
Required skills
Python, JavaScript, Rust, Node.js, Typescript, C, C++, Shell, TensorFlow, PyTorch, JAX, Keras, Pandas, NumPy, SQL, Git, clean code principles
Preferred skills
Web scraping, API integration, React, Flask, Deep Learning, NLP, Reinforcement Learning, Computer Vision, Game AI, Data Science
Technologies
TensorFlow, PyTorch, JAX, Keras, React, Flask, Node.js, Pandas, NumPy, Matplotlib, Seaborn, Git, GitHub
Responsibilities
Evaluate quality of AI model responses including code and ML; Generate and label code snippets and technical documentation; Provide feedback on model outputs; Compare and rank multiple outputs based on correctness and efficiency; Validate and correct datasets for model training; Collaborate with data scientists to refine annotation guidelines
Seniority
Individual Contributor