Afterquery

Research Engineer

San Francisco. Posted 2 months ago

The role

You will design and run training experiments to isolate the impact of datasets on model behavior. You will build post-training infrastructure for SFT and RL to measure how data affects capability, generalization, and alignment.

What you will do

  • Design and build post-training infrastructure for SFT, RL and evaluation workflows.
  • Build reliable pipelines for data preparation, dataset versioning, sampling, training, checkpoint management, and evaluation.
  • Develop experiment orchestration and tracking systems.
  • Create reusable abstractions to launch experiments across datasets, models, and training recipes.
  • Integrate systems with partner-lab training stacks, model APIs, compute environments, and evaluation infrastructure.

Required qualifications

  • At least 2 years of professional experience in machine learning engineering, research engineering, ML infrastructure, or a closely related field
  • Strong Python and software-engineering skills.
  • Hands on experience with PyTorch, JAX, Ray, and Slurm.
  • Experience building production-quality ML training, evaluation, or data infrastructure.
  • Hands-on experience with LLM fine-tuning, post-training, and evaluation.
  • Ability to build reliable, reproducible systems for launching and comparing ML experiments.
  • Strong debugging skills across distributed systems, data pipelines, training infrastructure, and model behavior.
  • Understanding of experimental design and the ability to extract actionable conclusions from noisy results.
  • Ability to move quickly between infrastructure engineering and hands-on experimentation.
  • A bias toward building, testing, and shipping.

Nice to have

  • 2-4+ years of professional experience in machine learning engineering, research engineering, ML infrastructure, or a closely related field

Benefits

  • Medical, Vision, Dental
  • 401(k) with Employer Match
  • Daily UberEats Stipend
  • Monthly Wellness Stipend

About the company

AfterQuery is an applied research lab curating data solutions for foundation model development. They serve frontier AI labs to deliver data to power models.

Research Engineer at Afterquery | JobZoey