Senior Research Scientist (Architectures Research)
Core
Develop new model architectures and methods to enable longer, richer workflows at lower computational cost for real-world AI use cases.
Role type
Senior Research Scientist (Model Architectures)
Builds
Open-source AI models, methods, and tools
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Transformers, attention mechanisms, language-model training, modern model architectures, Python, deep-learning frameworks, large-scale model training/evaluation, experimental design, technical communication
Preferred skills
Long-context modeling, memory systems, sparse/linear attention, model distillation, distributed training, efficient inference
Responsibilities
Formulate original research questions and design rigorous experimental programs; Design and evaluate architectural changes at meaningful model scales; Develop methods to reduce training or inference cost while preserving model quality; Collaborate with engineering teams to validate ideas in efficient implementations; Publish research and contribute to open-source models, methods, and tools; Mentor researchers and help shape the stream's research direction