Senior ML / Search & LLM Ops (Contractor)
Core
Direct hands-on execution, rapid prototyping, and delivering plug-and-play optimizations for the company's search and LLM stack in the financial domain.
Role type
Senior IC Machine Learning Engineer (Search & LLM Ops)
Builds
Production-grade ML models, PoCs, and optimized inference pipelines for financial AI agents.
Domain
Financial services / Generative AI / Search & Information Retrieval
Deliverable
production ML models
Required skills
Python, PyTorch, Hugging Face ecosystem (Transformers, PEFT, Accelerate), model quantization, high-performance inference frameworks (Triton, TEI, vLLM), AWS SageMaker, experiment tracking (MLflow, Opik)
Preferred skills
RLHF, Direct Preference Optimization (DPO), financial market data processing
Technologies
PEFT, LoRA, QLoRA, Distillation, DPO, PPO, AWQ, GPTQ, Triton Inference Server, TEI, vLLM, AWS SageMaker, Docker, Opik, MLflow
Responsibilities
Implement and evaluate targeted open-source LLM adaptations; benchmark and optimize model serving for low latency; prototype advanced search techniques including Matryoshka embeddings and hybrid search pipelines; package training, evaluation, and serving scripts into reproducible deliverables; set up synthetic data generation and automated evaluation harnesses.
Seniority
Senior, hands-on IC