Young Investigator, FlexOlmo

The role

This person will lead a high-impact research project and train leading models. They will work on large language models with a focus on Mixture-of-Experts, long-context language models, and retrieval.

What you will do

• Define and lead a high-impact research project.
• Train and release leading models.
• Collaborate with and learn from team members across Ai2.
• Build open-source software for the research community.
• Author scientific papers for publication in a high-profile conference or journal.
• Work 50% on leading and collaborating on an Ai2 project as an independent contributor.
• Work 50% on mentoring junior researchers.

Required qualifications

• Within one year of completing PhD, or already have a PhD, in Computer Science or similar field.
• Research experience in machine learning, natural language processing, language and vision, or related areas.
• Outstanding individual contributor skills, especially with deep learning frameworks (e.g. PyTorch).
• Outstanding publication record at AI-related venues, such as NeurIPS, ICLR, ICML, COLM, ACL, EMNLP.
• Extensive research experience in areas such as large language models, training dynamics, scaling laws, and data curation.
• Located or willing to relocate in Berkeley, CA.
• Must be able to remain in a stationary position for long periods of time.
• Ability to communicate information and ideas so others will understand.
• Ability to observe details at close range.
• Can work under deadlines.

Nice to have

• Experience with mixture-of-experts, long-context language models, and retrieval

Benefits

• Medical, dental, vision, basic life insurance, basic accidental death and dismemberment insurance, short-term disability, long-term disability, and an employee assistance program.
• Voluntary life insurance program.
• Voluntary accidental death and dismemberment program.
• Health savings account plan.
• Healthcare reimbursement arrangement plan.
• Health care and dependent care flexible spending account plans.
• 401k plan.
• $125 per month to assist with commuting or internet expenses.
• $200 per month for fitness and wellbeing expenses.
• Up to ten sick days per year.
• Up to seven personal days per year.
• Up to 20 vacation days per year.

Before you apply

• Visa sponsorship is available.

About the company

Ai2 is a Seattle based non-profit AI research institute founded in 2014 by the late Paul Allen. Their mission is building breakthrough AI to solve the world’s biggest problems.