AI Provider Operations & Support Engineer
Core
Own model launches and provider onboarding for an LLM marketplace, bringing new models to market and integrating new providers.
Role type
AI Provider Operations & Support Engineer
Builds
Internal tools for benchmarks, onboarding, and evaluations; end-to-end launch playbooks for various model types.
Domain
Artificial Intelligence / Large Language Models (LLMs)
Deliverable
production ML models | product features
Required skills
API integration (Chat Completions, Responses, Messages), TypeScript/JavaScript, Python, cURL, Postman, model evaluation, versioning, release management
Preferred skills
Startup experience, software engineering background, product operations experience
Technologies
TypeScript, JavaScript, Python, cURL, Postman
Responsibilities
Build internal tools to speed up model onboarding; Build internal evals to quickly evaluate models and endpoints; Document internal processes for automation; Run end-to-end launch playbooks for model types (text, audio, image, video, embeddings, rerankers); Coordinate with model providers to integrate, QA, and hit ship dates; Maintain versioning, release notes, deprecations, and migrations.
Seniority
Mid-level, hands-on IC
