Researcher, Training
Core
Designing, prototyping, and scaling new LLM architectures to enhance model intelligence, efficiency, and capabilities.
Role type
Senior IC LLM architecture researcher
Builds
Next-generation large language models (e.g., GPT-4o, o1-mini) and training/inference infrastructure
Domain
Artificial Intelligence / Large Language Models / Deep Learning
Deliverable
production ML models
Required skills
LLM architecture design, model inference optimization, experimental design and analysis, deep learning framework proficiency, transformer modification for efficiency, debugging complex regressions, performance bottleneck analysis
Preferred skills
Experience leading major LLM training runs, self-directed evaluation of deep learning architectures, practical knowledge of safely deploying LLMs
Technologies
PyTorch, JAX, Hugging Face Transformers, distributed training frameworks, custom inference engines
Responsibilities
Design and prototype novel model architectures, execute and analyze large-scale experiments, optimize model and computational performance, contribute to training and inference infrastructure
Seniority
Senior, hands-on IC