CareerPlanGet AI match score →

Applied AI Engineer, Codex Core Agent

San Francisco💼 Full-time🗓 2026-03-26 → 2026-07-31

Core

Designing and iterating agent behaviors for real-world software engineering tasks to improve solve rates and economic value.

Role type

Applied AI Engineer (LLM Agents)

Builds

Dependable agent tools for software engineering workflows

Domain

AI Research / Software Engineering / LLM Systems

Deliverable

production ML models

Required skills

Python, LLM-powered product development, model evaluation, fine-tuning, prompt design, tool-use strategies, context construction, debugging production failures

Preferred skills

Agent frameworks, tool-using LLM systems, code generation models, large dataset handling, production log analysis

Technologies

Python, modern ML tooling

Responsibilities

Design and iterate on agent behaviors across real-world coding tasks and long-horizon workflows; Develop and run evals to measure agent performance, regressions, failure modes, and edge cases; Improve performance through prompting, tool-use strategies, context construction, and model-facing experimentation; Analyze failures in production and systematically improve robustness and reliability; Build feedback loops and data systems that get better real-task data into evaluation and research; Work with product teams to shape user-facing agent experiences and the interfaces the agent depends on

Seniority

Mid-Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Ashby ↗