Senior Software Engineer II - Applied AI (Remote Eligible)
Core
Designing and owning the core infrastructure for Smartsheet's AI platform, enabling product teams to deploy reliable, scalable AI features with safety and consistency.
Role type
Senior Applied AI Platform Engineer (LLMOps)
Builds
Multi-tenant AI infrastructure, standardized APIs, and trust & safety systems for enterprise AI features.
Domain
Enterprise SaaS / Applied AI / LLMOps
Deliverable
production ML models | infrastructure
Required skills
LLM production experience, prompt engineering, context engineering, RAG architecture, LLM evaluation frameworks, Python, data-heavy environments
Preferred skills
Kubernetes (GPU scheduling), Infrastructure as Code (Terraform/Pulumi/AWS CDK), Vector Databases (Pinecone/Milvus/Weaviate), AI Gateways (LiteLLM/Kong), LLM Observability (Langfuse/LangSmith/MLflow), Model-Based Evals (RAGAS/DeepEval)
Technologies
Python, Databricks, Delta tables, Kubernetes, Terraform, Pulumi, AWS CDK, Pinecone, Milvus, Weaviate, LiteLLM, Kong, Langfuse, LangSmith, MLflow, RAGAS, DeepEval
Responsibilities
Lead design of core AI platform infrastructure; Architect high-level abstractions and Golden Path APIs; Establish monitoring and quality assurance layers for AI safety; Define technical roadmap for AI infrastructure.
Seniority
Senior, hands-on IC
