CareerPlan

Senior AI Software Engineer

San Francisco, CARemoteFull-time$149k–$240k2026-10-20 → 2026-11-19

Core

Design and develop high-performance, scalable services to support AI workloads across edge and cloud environments, including agent orchestration runtimes for LLMs.

Role type

Senior IC backend software engineer (AI/LLM systems)

Builds

Scalable microservices, APIs, and agent orchestration runtimes for edge-cloud AI integration

Domain

AI/ML, Edge Computing, Cloud Infrastructure

Deliverable

production ML models

Required skills

Java, C++, Python, LLM integration, agent orchestration, distributed systems, microservices, cloud-native development, SQL/NoSQL, data streaming

Preferred skills

AI model deployment, edge computing, cloud-edge hybrid architectures, TensorFlow Lite, ONNX Runtime, CoreML

Technologies

Java, C++, Python, LLMs, Microservices, SQL, NoSQL, TensorFlow Lite, ONNX Runtime, CoreML

Responsibilities

Design and maintain services powering AI-driven applications; Develop APIs and microservices for cloud-edge integration; Optimize data pipelines for real-time AI inference; Implement security and privacy for distributed AI systems; Build and optimize agent orchestration runtime for LLMs; Develop logging, monitoring, and alerting systems

Seniority

Senior, hands-on IC