Staff Software Engineer - ML Observability
Core
Building cutting-edge tools to monitor, explain, and improve AI systems in production, specifically Large Language Models (LLMs) and generative AI.
Role type
Staff Software Engineer - ML Observability
Builds
Robust, scalable observability for AI workloads including drift detection, model evaluation, and behavior tracing.
Domain
Generative AI / LLMs / Observability
Deliverable
production ML models
Required skills
distributed systems, scalable backend architectures, LLM-powered application development, model internals, inference pipelines, evaluation techniques, prompt engineering, observability tools/platforms
Preferred skills
product-oriented mindset, ability to thrive in ambiguous spaces, clean code practices, industry trend awareness
Technologies
LLMs, generative AI, observability platforms
Responsibilities
Drive design and implementation of LLM observability features; Ideate, prototype, and scale new product features for generative AI systems; Develop and extend tools for tracing, evaluating, and debugging LLMs; Influence architecture decisions and mentor engineers; Stay close to customer pain points to guide priorities; Stay current with industry trends in machine learning and observability.
Seniority
Staff, hands-on IC with strategic influence
