Research Scientist, Applied White-Box Methods

The role

You will take ownership of and accelerate the research agenda for the Applied White-Box Methods team. You will develop, evaluate, and demonstrate methods that leverage model internals to improve the safety of AI systems.

What you will do

• Take ownership of and accelerate the team's research agenda
• Publish findings broadly
• Engage with the AI alignment community
• Propose new directions within the team's agenda
• Attend relevant conferences and other community events

Required qualifications

• Hands-on experience applying at least one white-box method to a real model
• A track record in AI safety: a paper, a fellowship project, or substantive public writing
• Experience with evaluations, AI control, red-teaming, reinforcement learning, or post-training of LLMs
• The ability to communicate novel methods and results clearly to technical and non-technical audiences
• A PhD or several years of research experience in computer science, machine learning, physics, statistics, or a related field

Nice to have

• Prior hands-on experience with white-box methods and a demonstrated interest in their practical application
• Alumni of programs such as MATS, Astra, Anthropic Fellows, SPAR, Pivotal, LASR or similar programs
• Experience running large training runs
• Previous experience in applied ML for other fields: e.g. biology, chemistry, materials science, robotics, etc.

Benefits

• Health Insurance - 94% of Insurance premium paid by Organization commencing within 1 month after your start date
• Retirement - 401(k) plan with up to 2% match
• 25 days Paid Time Off per year, accrued weekly
• Up to 10 days of paid sick leave per year
• Paid Bereavement, Family, Medical and Pregnancy Disability Leave
• Work computer and stipend provided for eligible employees
• Catered lunches and dinners on workdays at our office in Berkeley
• Work-related travel and equipment expenses paid

Before you apply

• We sponsor visas for in-person employees
• Interviews with members of our technical staff
• A paid work trial of up to one week

About the company

FAR.AI is a non-profit AI research institute working to ensure advanced AI is safe and beneficial for everyone. The organization facilitates breakthrough AI safety research and advances global understanding of AI risks and solutions.