AI Engineer – AI Agents (Healthcare)
Core
Design, evaluate, and scale LLM-powered agents for healthcare workflows, focusing on building datasets, evaluation systems, and feedback loops to ensure reliability and accuracy.
Role type
Mid-level AI Engineer (LLM Agents & Evaluation)
Builds
Agentic workflows, evaluation pipelines, and internal tooling for model monitoring and iteration.
Domain
Healthcare + Generative AI / LLM Engineering
Deliverable
production ML models
Required skills
LLM engineering, prompt engineering, evaluation frameworks, dataset creation, system design, API integration, cloud environments, Python, JavaScript
Preferred skills
Voice AI, speech technologies, real-time agent systems, fine-tuning, retrieval strategies
Technologies
Python, JavaScript, LLMs, APIs, Cloud
Responsibilities
Build and maintain agentic workflows and training/evaluation datasets; Run systematic LLM evaluations and track regressions; Define and implement performance metrics (correctness, latency, safety); Develop internal tooling for evaluation and iteration; Build automated pipelines for model monitoring; Debug complex system behaviors across prompts, tools, and APIs.
Seniority
Mid-level, hands-on IC