AI Deployment Software Engineer
Core
Build and maintain production-ready AI systems, specifically the Omnix AI Advisor backend, serving as an AI agent to help customer admins improve security posture.
Role type
AI Deployment Software Engineer
Builds
Confidential AI experiences and the Omnix AI Advisor backend for customer administration
Domain
Cybersecurity / AI Infrastructure
Deliverable
production ML models
Required skills
Node.js, TypeScript, LLM engine deployment, inference orchestration, model evaluation, RAG integration, cloud infrastructure management, prompt engineering
Preferred skills
Fine-tuning open-source LLMs, self-hosted LLM infrastructure optimization, third-party partner integrations, legacy system modernization
Technologies
NodeJS, Typescript, llama.cpp, AWS EC2, AWS Nitro, Amazon ECS, MySQL, Aurora, Redis, S3, Gitlab, Terraform, ELK, Datadog, Claude Code
Responsibilities
Design and integrate AI solutions including prompt engineering and RAG; maintain and optimize inference engines; operate self-hosted LLM infrastructure; develop strategic third-party integrations; modernize legacy identity management systems
Seniority
Mid-Senior, hands-on IC