Senior Software Engineer, Machine Learning Platform
Core
Design and build scalable ML and AI infrastructure on AWS to enable data scientists and ML engineers to develop, train, deploy, and monitor models reliably, including support for LLMs and agentic systems.
Role type
Senior Software Engineer, Machine Learning Platform
Builds
Scalable ML/AI infrastructure, shared platform capabilities for LLMs and agents, evaluation frameworks, observability tools, and distributed training/inference systems.
Domain
Financial Technology / Machine Learning Platform Engineering
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, AWS cloud infrastructure, Python/Go/Scala/Java, CI/CD pipelines, Infrastructure as Code (Terraform), Containerization (Docker/Kubernetes), Data streaming (Kinesis/Kafka/Flink/Spark), Model training and evaluation, LLM application patterns (RAG, tool calling, agent orchestration)
Preferred skills
LLM-powered system production experience, Vector search/retrieval, Foundation model infrastructure (Bedrock/SageMaker), GPU workload optimization (CUDA)
Responsibilities
Design and operate scalable ML/AI infrastructure on AWS; Build shared platform capabilities for LLM and agentic workloads; Build evaluation frameworks for non-deterministic AI systems; Establish observability, reliability, and governance for models and agents; Help teams make principled architecture decisions; Build distributed training and large-scale processing systems; Support and evolve the feature store and pipelines; Develop data ingestion and streaming systems; Improve CI/CD workflows; Partner with Data Science and ML Engineering teams; Participate in on-call rotations.
Seniority
Senior, hands-on IC
