Senior Software Engineer - Systems
Core
Build and operate the core platform infrastructure for Boson's model APIs and agentic products, ensuring high reliability and performance for enterprise workflows.
Role type
Senior IC backend systems engineer (distributed systems & platform)
Builds
API serving layer, state management, data pipelines, context retrieval systems, and execution runtime for agentic workflows
Domain
Enterprise AI, Large Language Models (LLM), Agentic Systems
Deliverable
production ML models | infrastructure
Required skills
distributed systems design, high-throughput low-latency service architecture, data pipeline infrastructure, API design, systems programming, cloud infrastructure, containerized deployments, observability
Preferred skills
LLM serving, agentic orchestration patterns, RAG pipelines, real-time media systems, high-stakes platform services
Technologies
Kafka, Kinesis, Spark, Flink, Airflow, Go, Rust, Java, C++, Python, AWS, GCP, K8s
Responsibilities
Own and evolve core platform infrastructure including API serving, state management, and execution runtime; Design and operate high-throughput distributed services for model APIs; Build and maintain downstream data pipelines for logs, analytics, and billing; Develop production-grade internal SDKs and libraries; Architect context and memory systems for conversational workloads; Instrument end-to-end observability with SLIs/SLOs; Collaborate with ML and product teams on model serving and tooling infrastructure
Seniority
Senior, hands-on IC
