Afterquery

Research Program Manager

San Francisco. Posted a month ago

The role

You will run operations for research programs including public benchmark releases, partner collaborations, and the research roadmap. This technical role involves running evals, verifying results, and turning research needs into engineering and operational roadmaps.

What you will do

  • Serve as the point of contact for collaborations with academic and industry partners.
  • Coordinate benchmark releases end to end from launch through publication.
  • Maintain leaderboards and benchmark sites and verify results.
  • Track progress across all active research projects.
  • Anticipate resourcing gaps and technical bottlenecks.
  • Coordinate the expert pool for upcoming benchmarks.
  • Write external and internal communications including launch briefs and status memos.

Required qualifications

  • 1-3+ years in research operations, technical program management, or a similar role in a fast-moving research or engineering organization.
  • Technical background in computer science, machine learning, statistics, or a related field.
  • Working Python and SQL.
  • Evaluation literacy including ability to evaluate a product, agent, or foundation model and read results tables.
  • Excellent written and verbal communication.
  • A track record of running cross-functional programs end to end.
  • Comfort with ambiguity and building processes from scratch.

Nice to have

  • Graduate degree or research experience in a technical field.
  • Contributed to a benchmark, dataset, or evaluation project in any role.
  • Familiarity with public leaderboards or open research communities.
  • Exposure to programs with external partners, such as fellowships, grants, or academic collaborations.
  • Exposure to expert or annotator pools, or other human-data work.
  • Comfort with lightweight dashboards or building small tools with AI assistants.

Benefits

  • Medical, Vision, Dental
  • 401(k) with Employer Match
  • Daily UberEats Stipend
  • Monthly Wellness Stipend

About the company

AfterQuery is an applied research lab curating data solutions for foundation model development. They are based in San Francisco and serve frontier AI labs.

Research Program Manager at Afterquery | JobZoey