Software Engineer - Platform & Application
Core
Build and operate the core platform infrastructure for Boson's model APIs and agentic products, including API serving, state management, data pipelines, and execution runtime.
Role type
Junior Software Engineer (Platform & Infrastructure)
Builds
Distributed services, API serving layers, data pipelines, and internal SDKs for agentic workflows.
Domain
Enterprise AI, Large Language Models (LLM), Agentic Systems
Deliverable
production ML models | infrastructure
Required skills
Python, Go, Java, Rust, or C++, distributed systems concepts, backend service development, API design, data pipeline construction, cloud infrastructure basics, containerization, CI/CD
Preferred skills
LLM serving experience, retrieval systems, vector stores, real-time media streaming, agent frameworks
Responsibilities
Contribute to API serving layer, state management, and execution runtime; build and maintain distributed services for model APIs; develop data pipelines for logs and analytics; create internal SDKs and libraries; support context and memory systems; add observability and resolve reliability issues; collaborate with ML and product teams on model serving integration.
Seniority
Junior, early career with mentorship
