CareerPlanSign in

Software Engineer II

USA💼 Full-time🗓 2026-09-05 → 2026-09-25

Core

Build and enhance model registries, feature registries, governance tooling, and cloud-native microservices for scalable LLM-powered model delivery and operations.

Role type

Software Engineer II (LLM & MLOps)

Builds

Model registries, feature stores, governance tooling, data preparation services, annotation workflows, and LLM-powered agent applications.

Domain

Artificial Intelligence / Machine Learning Operations / Cloud Infrastructure

Deliverable

production ML models | infrastructure

Required skills

Microservices architecture, LLM prompt design, agent workflows, retrieval-augmented generation, RESTful API development, cloud platforms, container orchestration, database management, test-driven development, AI-assisted development tool validation

Preferred skills

Modern JavaScript frameworks, model governance, data governance, developer-experience tooling

Technologies

Python, Java, JavaScript, React, Node.js, PostgreSQL, MongoDB, Redis, Elasticsearch, Cassandra, Docker, Kubernetes

Responsibilities

Design and deliver services for data preparation and annotation workflows; Develop cloud-native microservices and APIs for model delivery; Create LLM-powered capabilities using prompt design and agent workflows; Produce architecture artifacts meeting performance and security constraints; Analyze telemetry and build reporting to improve code health and observability

Seniority

Mid-level, hands-on IC

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.