Young Investigator, FlexOlmo Berkeley, CA View job
Role: Young Investigator, FlexOlmo
Location: Berkeley, CA (Remote work welcome from Berkeley, CA)
Compensation: $159,650
Role Overview:
Ai2 is seeking a talented and motivated Postdoctoral Young Investigator to join the FlexOlmo team, working on a series of large language models designed for flexible data use, with a focus on Mixture-of-Experts (MoE), long-context language models (LCLMs), and retrieval. This is a postdoctoral program offering unique benefits, enabling you to balance working collaboratively on an Ai2 project while having opportunities to mentor junior researchers. The position duration is 1-3 years with a flexible start date.
Responsibilities:
- Define and lead a high-impact research project.
- Train and release leading models.
- Collaborate with and learn from team members across Ai2.
- Build open-source software for the research community.
- Author scientific papers for publication in a high-profile conference or journal.
- Work 50% as an independent contributor leading and collaborating on an Ai2 project.
- Work 50% mentoring junior researchers (PhD students/interns, predoctoral students/interns) and receiving mentorship in academic activities such as grant writing and teaching, if desired.
Qualifications and Requirements:
- Within one year of completing their PhD, or already have a PhD, in Computer Science or similar field with research experience in machine learning, natural language processing, language and vision, or related areas.
- Outstanding individual contributor (IC) skills, especially with deep learning frameworks (e.g. PyTorch).
- An outstanding publication record at AI-related venues, such as NeurIPS, ICLR, ICML, COLM, ACL, EMNLP. Evaluation focuses on the quality of publications in terms of rigor and impact, not quantity.
- Extensive research experience in areas such as large language models, training dynamics, scaling laws, and data curation. Experience with mixture-of-experts, long-context language models, and retrieval is preferred but not required.
- Located in or willing to relocate to Berkeley, CA.
Physical Demands and Work Environment:
- Must be able to remain in a stationary position for long periods of time.
- The ability to communicate information and ideas so others will understand.
- The ability to observe details at close range.
- Can work under deadlines.
What They Offer:
- Competitive pay and visa sponsorship availability.
- Dedicated Ai2 mentor who is also a faculty member at the University of California, Berkeley.
- Opportunities to engage actively with the University of California, Berkeley, and the BAIR lab.
- Commitment to open science and support for freely publishing papers.
- Learning organization culture with weekly Ai2 Academy lectures and world-class AI experts as guest speakers.
- Emphasis on healthy work/life balance with generous paid vacation, sick leave, and family leave.
- Benefits include medical, dental, vision, basic life insurance, basic accidental death and dismemberment insurance, short-term disability, long-term disability, and an employee assistance program.
- Voluntary life insurance, voluntary accidental death and dismemberment, health savings account, healthcare reimbursement arrangement, and flexible spending accounts.
- Company 401k plan.
- $125 per month for commuting or internet expenses and $200 per month for fitness and wellbeing expenses.
- Up to ten sick days, up to seven personal days, up to 20 vacation days, and twelve paid holidays per year.
- Annual bonuses.