Applied AI Engineer
Core
Build and operate the production infrastructure for large language models (LLMs), including a centralized gateway, inference runtime, and release gates to ensure safe, reliable, and auditable deployment of AI services.
Role type
Senior backend engineer specializing in LLM infrastructure and platform engineering
Builds
A centralized LLM gateway, inference runtime, and CI/CD release path for model and prompt changes
Domain
Artificial Intelligence / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
Backend software engineering, Python, LLM API integration, CI/CD pipeline design, Infrastructure as Code, Observability, Application security
Preferred skills
Regulated domain experience (Healthcare/Life Sciences), Internal developer platform experience, LLM evaluation techniques, Model fine-tuning
Technologies
Python, AWS, ECS, Terraform, Pulumi, CDK, OpenTelemetry, Datadog, Anthropic, OpenAI, Azure OpenAI
