Snorkelai

Research Scientist - Human-AI Systems

New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote). Posted a month ago

The role

You will build and optimize pipelines that combine real-world data, automated generation, and human expert input. You will work with domain experts, academic partners, customers, and product and engineering teams to scale these pipelines.

What you will do

  • Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment.
  • Design and run rigorous experiments to validate proof-of-concept approaches and communicate findings.
  • Partner with engineering, data operation, domain experts, and customers to turn research prototypes into production workflows.
  • Work with domain experts to design and test workflows for authoring, reviewing, and refining data and environments.
  • Work cross-functionally to surface research findings that inform the company roadmap.
  • Stay at the frontier of research in data and agentic environment creation.
  • Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements.

Required qualifications

  • Strong research background in AI, machine learning, NLP, LLMs, or related fields, with experience developing and evaluating new methods.
  • Experience building environments for AI agents in automated research, computer use, coding, or professional domain workflows.
  • Experience with one or more of synthetic data generation, human in the loop workflows, reinforcement learning, agent environments, or model evaluation.
  • Strong experimental design skills, including defining hypotheses and conducting ablations.
  • Experience with software engineering best practices (e.g., clean coding, modular design, version control).
  • Ability to collaborate with domain experts and translate their knowledge into concrete tasks, evaluation criteria, and repeatable workflows.
  • Comfort with rapid iteration, ambiguous research questions, and moving ideas from experimentation into production.

Nice to have

  • Ph.D. in machine learning, NLP, or a related field

About the company

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises.

Research Scientist - Human-AI Systems at Snorkelai | JobZoey