Senior System Software Engineer, Agentic Retrieval
Core
Develop pipelines for indexing and querying multi-modal content to build powerful, flexible retrievers and agents driven by Large Language Models (LLM).
Role type
Senior System Software Engineer (Agentic Retrieval)
Builds
GPU-accelerated data processing frameworks and Agentic Retrieval pipelines for LLM training and multimodal models.
Domain
Generative AI, LLM, VLLM, Agentic Retrieval, Multi-modal AI
Deliverable
production ML models
Required skills
Rust, Python, GPU programming, LLM/VLM/Generative AI workflows, MLOps, Cloud infrastructure management, System optimization, Prompt engineering, Fine-tuning
Preferred skills
Micro-optimization, Benchmarking, Profiling, Continuous Delivery pipeline management
Technologies
Rust, Python, Docker, Kubernetes, GPU-accelerated environments
Responsibilities
Develop and optimize Rust-based data processing frameworks for large datasets on GPU; Lead development and optimization of Agentic Retrieval pipeline components; Collaborate with researchers on full-stack GPU-accelerated data preparation pipelines; Implement benchmarking, profiling, and optimization of algorithms for LLM applications; Build and maintain Continuous Delivery pipelines; Provide peer reviews on performance, scalability, and correctness.
Seniority
Senior, hands-on IC