CareerPlanSign in

LLM Engineer (GenAI, NYC)

NYC Hybrid💼 Full-time🗓 2025-10-17 → 2026-09-26

Core

Build next-generation AI tools and reliable AI agents to preserve critical thinking and enhance content integrity for educators, students, journalists, and writers.

Role type

Senior LLM Engineer (GenAI)

Builds

AI detection platform features, multi-agent workflows, and prompt-optimized classification systems

Domain

Generative AI, Natural Language Processing, Information Integrity

Deliverable

production ML models | product features

Required skills

Python, LLM frameworks (Langchain, LlamaIndex), agentic workflows, RAG, prompt engineering, exploratory data analysis, modular codebase architecture, software engineering

Preferred skills

open-source contributions, top-tier ML publications, early-stage startup experience, prompt optimization frameworks (DsPY, TextGrad)

Technologies

Python, Langchain, LlamaIndex, RAG, DsPY, TextGrad

Responsibilities

Fine-tune and evaluate state-of-the-art language models; Optimize prompts to maximize classification accuracy and enforce style guidelines; Develop multi-agent workflows incorporating data from diverse sources; Improve and iterate on AI agents using observability and experimentation tools; Stay up-to-date with the latest literature and emerging technologies to solve novel problems; Work closely with product and design teams to develop intuitive applications

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.