Senior Software Developer – Machine Learning Platform
Core
Build a scalable Machine Learning Platform to train thousands of models and serve hundreds of millions of queries daily, including Large Language Models (LLMs) and agentic workflows.
Role type
Senior Backend Developer (Machine Learning Platform)
Builds
Production-ready ML infrastructure, agentic workflows, and scalable services for Coveo users
Domain
AI/ML Infrastructure, Distributed Systems, Cloud Computing
Deliverable
production ML models | infrastructure
Required skills
Backend development, distributed systems, scalable application design, debugging, cloud environment experience
Preferred skills
Terraform, AWS Bedrock, vector databases, LLM inference gateways, machine learning workflows, agentic workflows
Technologies
Python, Java/Spring, AWS, Terraform, AWS Bedrock, OpenSearch, LiteLLM
Responsibilities
Contribute to development lifecycle (coding, testing, deployment), improve platform observability and reliability, maintain services handling millions of requests, integrate agentic applications into production, suggest process improvements
Seniority
Senior, hands-on IC