Snorkelai
Research Scientist - Human-AI Systems
New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote). Posted a month ago
The role
You will build and optimize pipelines that combine real-world data, automated generation, and human expert input. You will work with domain experts, academic partners, customers, and product and engineering teams to scale these pipelines.
What you will do
- Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment.
- Design and run rigorous experiments to validate proof-of-concept approaches and communicate findings.
- Partner with engineering, data operation, domain experts, and customers to turn research prototypes into production workflows.
- Work with domain experts to design and test workflows for authoring, reviewing, and refining data and environments.
- Work cross-functionally to surface research findings that inform the company roadmap.
- Stay at the frontier of research in data and agentic environment creation.
- Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements.
Required qualifications
- Strong research background in AI, machine learning, NLP, LLMs, or related fields, with experience developing and evaluating new methods.
- Experience building environments for AI agents in automated research, computer use, coding, or professional domain workflows.
- Experience with one or more of synthetic data generation, human in the loop workflows, reinforcement learning, agent environments, or model evaluation.
- Strong experimental design skills, including defining hypotheses and conducting ablations.
- Experience with software engineering best practices (e.g., clean coding, modular design, version control).
- Ability to collaborate with domain experts and translate their knowledge into concrete tasks, evaluation criteria, and repeatable workflows.
- Comfort with rapid iteration, ambiguous research questions, and moving ideas from experimentation into production.
Nice to have
- Ph.D. in machine learning, NLP, or a related field
About the company
Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises.