AI Software Engineer
Core
Architect, design, and lead multi-agent LLM systems and RAG pipelines for financial services applications, focusing on summarization, query routing, and retrieval with high precision and low latency.
Role type
Senior IC AI Software Engineer (GenAI & RAG)
Builds
Production multi-agent LLM systems, RAG pipelines, and evaluation frameworks for financial analysis and customer support.
Domain
Financial Services / Generative AI / Retrieval-Augmented Generation
Deliverable
production ML models
Required skills
Multi-agent orchestration, RAG pipeline architecture, LLM fine-tuning, vector search implementation, system design for low-latency AI, data ingestion pipelines, observability setup, cross-functional collaboration
Preferred skills
Reranker-based retrieval, prompt evaluation metrics, credit risk domain knowledge, RAG benchmark automation
Technologies
LangGraph, LangChain, Promptfoo, LanceDB, Pinecone, Elasticsearch, GPT-4o, PaLM 2, LLaMA, Mistral, BERT, SentenceTransformers, MongoDB, Redis Streams, AWS EKS, Azure Kubernetes Service, Azure DevOps, OpenTelemetry, Signoz, FastAPI, React, Python, SQL, Git, Pandas, NumPy
Responsibilities
Architect and lead multi-agent LLM systems using LangGraph and LangChain; Build RAG pipelines leveraging hybrid vector search; Integrate and fine-tune transformer models for task-specific Q&A; Implement multi-agent architectures with modular flows and fallback behaviors; Architect ingestion pipelines for structured and unstructured financial data; Deploy end-to-end AI systems on Kubernetes with comprehensive monitoring; Mentor a small team of GenAI developers and data engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities