CareerPlanSign in

Associate Consultant, Generative AI

New York, NY, us💼 Full-time💰 $80,000–$110,000🗓 2026-09-08 → 2026-09-25

Core

Design, build, train, fine-tune, and deploy LLM-powered solutions (RAG, agents, fine-tuning) for clients across industries to solve real business problems.

Role type

Associate Consultant, Generative AI (hands-on IC)

Builds

Production GenAI applications, scalable AI systems, and MLOps pipelines for enterprise clients

Domain

Management Consulting, Generative AI, Large Language Models

Deliverable

production ML models | product features

Required skills

Python programming, GenAI frameworks (LangChain, LlamaIndex), NLP concepts, vector embeddings, semantic search, cloud platforms (AWS/Azure/GCP), prompt engineering, model fine-tuning, MLOps practices

Preferred skills

Agentic AI systems (LangGraph, AutoGen), vector databases (Pinecone, Chroma), Model Context Protocol (MCP), Docker, Git, CI/CD workflows

Technologies

Claude, GPT, Gemini, Llama, Mistral, LangChain, LlamaIndex, Pinecone, Chroma, pgvector, OpenSearch, AWS, Azure, GCP

Responsibilities

Design and implement GenAI/LLM solutions using various models and techniques; Support solution architects in designing scalable applications; Develop GenAI-powered applications compliant with regulations; Optimize prompts for analytical capabilities and user experience; Implement RAG architectures for accuracy and traceability; Select and fine-tune models including multimodal and small language models; Implement MLOps best practices for automated pipelines and monitoring; Develop evaluation frameworks for model performance and safety; Research and experiment with new GenAI approaches; Document processes and methodologies.

Seniority

Junior, recent graduate (0-2 years experience)

Sourced via smartrecruiters · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.