Software Engineer, Model Capabilities
Core
Own the model layer of Notion AI, integrating frontier models, ensuring reliable inference at scale, and building new model-level capabilities for product teams.
Role type
Senior IC machine-learning engineer (LLM infrastructure)
Builds
Production AI systems integrating frontier LLMs, reliable inference pipelines, and observability tools
Domain
AI / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
LLM API integration, inference reliability engineering, observability, token economics, streaming, tool calling, context management, cost-performance tradeoff analysis
Preferred skills
Experience with cross-provider failover, self-healing systems, evaluation framework design
Technologies
LLM APIs, inference platforms, observability tools
Responsibilities
Integrate new frontier models into production, improve inference reliability via error categorization and failover, own observability metrics, build new model capabilities, unblock AI teams
Seniority
Senior, hands-on IC
