AI Engineer - New York
Core
Design, develop, test, deploy, and support large-scale production AI systems, including foundation model training, LLM inference, agentic workflows, and multi-model orchestration pipelines to improve scalability, cost, and latency.
Role type
Senior IC AI Engineer (Large-scale Production Systems)
Builds
Scalable, responsible AI systems and unified production pipelines integrating LLMs, vector search, and domain-specific models.
Domain
Financial Services / Large-scale AI Engineering
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, LLM inference, similarity search, VectorDBs, model optimization, agentic AI systems, multi-model orchestration, cost-performance governance, hardware utilization optimization
Preferred skills
Leading AI system development with tradeoff analysis, deploying scalable AI on cloud platforms, designing complex AI systems, building agentic workflows, architecting heterogeneous AI systems, enforcing ethical AI standards, dynamic inference strategies, model compression, right-sizing models
Technologies
AWS Ultraclusters, Hugging Face, VectorDBs, PyTorch, C#, CUDA, Golang, Java, LLM, Model Training
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; design and optimize multi-model orchestration pipelines; lead cost-performance governance reviews; establish and lead design councils; mentor Principal- and Manager-level AI engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities
