Senior ML Platform Engineer (GenAI Platform)
Core
Design and build systems for production GenAI workloads, including gateways, evaluation, observability, and guardrails to enable safe, scalable AI experiences.
Role type
Senior IC ML Platform Engineer (GenAI)
Builds
GenAI gateway, model lifecycle management, evaluation frameworks, observability stacks, and safety guardrails for product teams.
Domain
EdTech / Generative AI Infrastructure
Deliverable
production ML models
Required skills
Python, distributed systems, GenAI systems (vector retrieval, provider APIs), cloud infrastructure (AWS), distributed tracing, SLOs, incident triage, prompt engineering workflows, system architecture
Preferred skills
AI gateways, scalable model serving, evaluation suites, prompt management, vector databases, Metaflow, Databricks, AWS SageMaker, GPU compute optimization, agentic workflows
Technologies
Python, AWS, vector databases, agentic frameworks, CI/CD tools
Responsibilities
Architect unified gateway with automated routing and quota controls; drive system efficiency via dynamic traffic management and caching; establish robust evaluation mechanisms; deliver system observability and alerting; standardize prompt engineering workflows; embed platform guardrails for safety; maintain incident response and postmortems.
Seniority
Senior, hands-on IC
