AI Platform Engineer (m/f/x)
Core
Design and maintain the foundational infrastructure enabling AI Software Engineers to build and scale generative AI applications, focusing on model access, observability, and governance.
Role type
AI Platform Engineer
Builds
Internal AI provisioning platform, LLM observability systems, and secure agentic workflow integrations
Domain
Fintech / Generative AI Infrastructure
Deliverable
production ML models
Required skills
Cloud infrastructure (AWS), Infrastructure as Code (Terraform), Python or Go, CI/CD pipelines, containerization (Docker), API cost management, rate limiting, data privacy
Preferred skills
LLM gateways, observability platforms (Datadog, Langfuse), telemetry (LiteLLM)
Technologies
AWS, Terraform, Python, Go, Docker, Datadog, Langfuse, LiteLLM
Responsibilities
Develop and maintain an internal AI provisioning platform for LLMs & MCP Servers; Implement LLM observability, logging, and alerting systems; Enforce model governance including security, data privacy, and cost management; Collaborate with AI Software Engineers on cloud-native architectures; Build infrastructure for monitoring production AI systems reliability and performance
Seniority
Mid-Senior, hands-on IC
