Senior Software Development Engineer - GenAI
Core
Design and build core platform services for CVS Health's foundational AI/GenAI platform, enabling engineering teams to safely and cost-effectively build LLM-driven tooling and agentic workflows.
Role type
Senior IC GenAI platform engineer
Builds
Foundational AI/GenAI platform services including LLM routing, cost governance, RAG capabilities, and orchestration tools for agentic workflows
Domain
Healthcare technology + Generative AI infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, TypeScript/Node.js, RESTful APIs, microservices, LLM provider APIs, cloud platforms, Redis, Kafka, MongoDB, OAuth2/OIDC, observability tooling, Docker, CI/CD, Git
Preferred skills
GenAI infrastructure design, distributed system design, regulated industry compliance, prompt engineering, model routing strategies
Technologies
FastAPI, Flask, Express, NestJS, AWS, Azure, GCP, OpenTelemetry, Prometheus, Grafana, Langfuse, Datadog
Responsibilities
Design and build core platform services spanning auth, quota/cost management, observability, and routing policy; define next-generation foundational AI services; navigate compliance realities of operating in a healthcare environment
Seniority
Senior, hands-on IC