Senior SWE - Python / TypeScript - USA (Contract)
Core
Design, refine, and iterate on rubrics and evaluation criteria for preference data; build and maintain pipelines/infra supporting data generation, collection, and evaluation workflows.
Role type
Senior Staff Engineer (AI Data Infrastructure & Evaluation)
Builds
Data generation, collection, and evaluation workflows for AI companies
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Python (pipelines/infra), TypeScript, Golang, JavaScript, preference data collection, rubric creation, data quality judgment, technical writing
Preferred skills
Large codebase navigation (VSCode), qualitative judgment articulation
Technologies
Python, TypeScript, Golang, JavaScript
Responsibilities
Design and refine rubrics for preference data, review and label data with high quality standards, build and maintain data pipelines, synthesize findings into clear recommendations, collaborate with researchers to translate judgment into scalable processes
Seniority
Senior, hands-on IC
