Staff Software Engineer (AI Backend Services)
Core
Define technical strategy and architecture for Python-based AI backend platforms supporting LLM integration, generative AI pipelines, and AI agent orchestration.
Role type
Staff Software Engineer (AI Backend Services)
Builds
Scalable, reliable, and secure backend systems on AWS infrastructure serving as the foundation for multiple teams.
Domain
Generative AI, Large Language Models (LLM), Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, FastAPI, AWS (Lambda, EKS), LLMs, LangChain, litellm, Langfuse, Microservices, Distributed Systems, Docker, Kubernetes
Preferred skills
Asynchronous Python, Event-driven architectures, MLOps, Infrastructure-as-code, CI/CD automation
Technologies
Python, FastAPI, AWS, Lambda, EKS, LangChain, Langfuse, litellm, Docker, Kubernetes
Responsibilities
Define technical strategy and architecture for Python-based AI backend platforms; Architect scalable systems on AWS; Drive technical decisions impacting organization-wide practices; Design AI system observability; Establish engineering standards for monitoring and logging; Lead cross-functional initiatives to optimize performance and security; Mentor engineers at all levels; Identify and resolve technical debt; Collaborate with leadership to align technical strategy with business objectives.
Seniority
Staff, strategic technical leadership & mentorship
