CareerPlanGet AI match score →

Staff Software Engineer, MDLC

🌐 Remote💼 Full-time🗓 2026-06-24

Core

Building and enhancing platform features for multi-agent workflows, custom module extensions, and high-throughput LLM inference infrastructure.

Role type

Staff Software Engineer (Backend/Platform)

Builds

Domino's model development lifecycle platform, including API integrations, model registry, and scalable training resources.

Domain

AI/ML infrastructure, distributed computing, enterprise software.

Deliverable

production ML models | product features | infrastructure

Required skills

High-performance back-end systems development, distributed computing, API design (RESTful, gRPC), performance profiling, CI/CD pipeline setup, cloud deployment (AWS/Azure/GCP), Python/Java/Scala/Go

Preferred skills

Apache Spark, Azure ML, SageMaker, container technologies (Docker, Kubernetes), traditional ML model development workflows

Technologies

Ray, Spark, Docker, Kubernetes, AWS, Azure, GCP, RESTful APIs, gRPC

Responsibilities

Build and enhance platform features for multi-agent workflows, expand the Extensions framework for custom modules, expand inference infrastructure for LLM serving, integrate systems with front-end interfaces and third-party services, profile and optimize back-end performance, set up CI/CD pipelines

Seniority

Staff, hands-on IC with strategic impact

Rewrite
## About the role At Domino, we build software that helps the largest, AI-driven organizations build and operate advanced data science and AI solutions at scale. Our platform integrates a streamlined model development environment, MLOps capabilities, and novel features for collaboration, reuse, and reproducibility — all of which make data science teams more productive, reduce time to value, and ensure compliance. Our customers — like Johnson & Johnson, GSK, Bristol Myers, UBS, FINRA and the US Navy — are using our software to solve some of the most important challenges in the world, such as developing new medicines, securing our financial markets, or protecting our country. Backed by Sequoia Capital, Coatue Management, NVIDIA, Snowflake and other leading investors, we have been in business for a decade but are still a small team operating with the spirit of a startup. Especially in the world of AI today, we believe that the future is still being invented — and we want to be the ones building it. For more information, visit www.domino.ai ## What we are building The Model Development Lifecycle Team is building a cutting-edge platform to simplify the entire machine learning journey. From development and training to deployment and management, we empower teams to turn data into actionable insights. Our platform supports: - Seamless API Integration: Deploy models as APIs for consistent use across applications, whether on-premises, in enterprise infrastructures, or through third-party hosting. - Collaboration and Discoverability: Use our model registry to version, store, and easily find models across the organization. - Scalable Training Resources: Leverage advanced tools like GPUs, Ray, and Spark to meet the needs of diverse AI projects. By supporting organizations in developing, registering, and scaling AI models, we enable impactful insights and innovation across the enterprise. ## What your impact will be In your first year, you will: - Build and enhance platform features that enable teams to design, test, and deploy multi-agent workflows at scale. - Enhance Domino's Extensions framework for enabling customers to build custom modules that extend platform feature and function - Expand the platform's inference infrastructure to support high-throughput, low-latency serving of large language models, helping customers confidently operationalize LLM applications at enterprise scale. ## What we look for in this role - Building Scalable Systems: Hands-on experience developing and managing high-performance back-end systems in distributed computing environments - Collaboration Across Teams: Working closely with cross-functional teams to integrate systems with front-end interfaces and third-party services - API Development: Designing and implementing secure, scalable APIs (e.g., RESTful APIs, gRPC) - Performance Optimization: Profiling and optimizing back-end performance, especially in cloud environments or with container technologies like Docker and Kubernetes. - Testing and CI/CD: Using robust testing frameworks (unit, integration, end-to-end) and setting up CI/CD pipelines - Familiarity with traditional machine learning model development and AI workflows, including experiment tracking, hyperparameter optimization, model evaluation frameworks, and managing model artifacts - Distributed Computing: Experience with frameworks like Apache Spark, Azure ML, or SageMaker is a plus - Cloud Platforms: Proficiency with cloud providers (AWS, Azure, GCP) and deploying services in these environments - Back-End Development: Expertise in languages such as Python, Java, Scala, or Go ## What we value - We value a growth mindset. High-performing creative individuals who dig into problems and see the opportunities for success - We believe in individuals who seek truth and speak the truth and can be their whole selves at work - We value all of you that believe improving is always possible At Domino Everything is a work in progress – we can do better at everything - We emphasize an environment of teaching and learning to equip employees with the tools needed to be successful in their function and the company - We strongly believe in the value of growing a diverse team and encourage people of all backgrounds, genders, ethnicities, abilities, and sexual orientations to apply #LI-Remote
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Wellfound ↗