Principal, AI Platform Engineering
Core
Design and build an enterprise-grade generative AI platform enabling teams to build, deploy, and operationalize AI applications with security and compliance.
Role type
Principal AI Platform Engineer
Builds
Enterprise AI platform including multi-LLM gateways, RAG services, model registries, prompt libraries, and deployment pipelines
Domain
Financial services / Generative AI infrastructure
Deliverable
production ML models
Required skills
Generative AI and LLM architecture, RAG system design, Python/Go/Rust/Java, Model serving (vLLM, Ollama), Vector databases, Cloud platforms (AWS/GCP/Azure), Kubernetes, Security architecture (RBAC, ABAC, encryption), Compliance frameworks (SOC 2, ISO 27001, GDPR)
Preferred skills
Financial services technology, AI orchestration frameworks (LangChain, LlamaIndex), MLOps tools, Model evaluation frameworks, Data governance platforms, Zero-trust architecture
Technologies
vLLM, Ollama, TensorFlow Serving, Docker, Kubernetes, AWS, GCP, Azure
Responsibilities
Architect multi-LLM gateway capabilities, Develop RAG retrieval services, Create model registry and governance, Design prompt library and version control, Implement Model Context Protocol (MCP) gateway, Build FinOps infrastructure, Design orchestration framework for agent-to-agent workflows, Partner with data platform teams for AI-native data access, Design sandbox-to-production pipelines, Implement CI/CD for AI models, Build observability and monitoring, Design and implement comprehensive security architecture, Ensure platform compliance with regulatory requirements
Seniority
Principal, hands-on IC with strategic leadership