Senior Software Engineer
Core
Reviewing and evaluating real-world software engineering tasks derived from open-source repositories for technical soundness, reproducibility, and quality.
Role type
Senior Software Engineer (Technical Evaluation & Code Review)
Builds
High-quality, reproducible software engineering tasks for benchmarking and evaluation
Domain
Software Engineering, Open Source, Code Quality
Deliverable
production ML models
Required skills
Software engineering, Pull request review, Unit testing, Test coverage analysis, Dependency management, Git/GitHub workflows, Technical problem analysis, Written technical feedback
Preferred skills
Open-source contributions, SWE-Bench experience, Python frameworks (Django, Flask, scikit-learn), Docker/CI/CD, Test isolation design, AI/ML evaluation
Technologies
GitHub, Git, Python, Docker, CI/CD, pytest, scikit-learn, Django, Flask
Responsibilities
Review coding tasks from GitHub issues/PRs, Assess problem statement clarity, Evaluate unit tests for correctness and robustness, Identify flaky tests and environment issues, Determine task reproducibility, Assess task difficulty and complexity, Provide recommendations on task acceptance
Seniority
Senior, hands-on IC
