AI Research Engineer (Pre-training - LLM & Multi-Modal) - 100% Remote Worldwide
Core
Drive innovation in architecture development for cutting-edge Large Language Models (LLM) and Multi-Modal systems, focusing on pre-training optimization and novel techniques.
Role type
Senior IC AI Research Engineer (Pre-training - LLM & Multi-Modal)
Builds
Cutting-edge LLM and Multi-Modal models for Tether's AI model team
Domain
Artificial Intelligence, Large Language Models, Multi-Modal AI
Deliverable
production ML models
Required skills
Large-scale LLM and Multi-Modal pre-training, Transformer architecture design, Distributed training systems, Data curation and pipeline creation, PyTorch, Hugging Face, NVIDIA GPU cluster management, Cross-modal alignment, Model optimization and debugging
Preferred skills
PhD in NLP/Machine Learning, Publications in A* conferences, Experience with non-transformer modifications
Technologies
PyTorch, Hugging Face, NVIDIA GPUs, Distributed training frameworks
Responsibilities
Conduct foundational pre-training for LLMs and Multi-Modal models on large distributed servers; Design, prototype, and scale innovative architectures, tokenizers, and cross-modal alignment layers; Source, filter, and curate massive-scale textual and multi-modal datasets; Execute experiments and refine training methodologies; Investigate and eliminate bottlenecks in model efficiency and alignment stability; Contribute to the advancement of distributed training systems
Seniority
Senior, hands-on IC