Zyphra

Research Engineer -- Vision and Vision-Language Models

San Francisco. Posted a month ago

The role

You will be a core contributor on the Vision Team building models for image understanding, computer use, and agentic visual tasks. You will work across the full model development stack including data sourcing, pretraining, post-training, reinforcement learning, and evaluation.

What you will do

  • End-to-end pretraining and post-training of vision-language models
  • Large-scale vision and multimodal training runs
  • Vision and multimodal dataset sourcing, generation, curation, processing, and evaluation
  • Reinforcement learning and other post-training methodologies for vision-language models
  • Computer use, visual agents, and other multi-turn agentic vision tasks
  • Architecture, data, and training methodology ablations and improvements
  • Performance optimization of training and data processing stacks

Required qualifications

  • Strong research taste and intuition
  • Strong implementation and prototyping ability
  • A high rate of learning and an ability to rapidly become effective in unfamiliar technical areas
  • Strong general machine learning intuition
  • Ability to work well with others in a high-paced research setting
  • Excellent communication and collaboration skills
  • Experience with large-scale model pretraining, post-training, reinforcement learning, or related methodologies
  • Experience sourcing, generating, or curating vision datasets, including synthetic data generation
  • Familiarity with image processing tools, libraries, or pipelines
  • Experience training models on large-scale, multi-node GPU clusters
  • Strong grasp of experimental methodology for running rigorous ablations and hypothesis testing
  • Understanding of large-scale, highly parallel data processing pipelines

Nice to have

  • Experience working with vision, vision-language, video, or other multimodal models or datasets is highly valuable
  • Experience training vision-language models is a plus
  • Experience with computer use agents, visual agents, GUI understanding, or other multi-turn multimodal tasks is a plus
  • Experience with frontend development, web frameworks, UI/UX implementation, or mobile development is valuable
  • Published machine learning research in well-respected venues is a plus
  • Postgraduate study in a scientific or technical field such as Computer Science, EE/EECS, Mathematics, Physics, or Machine Learning is a plus

Benefits

  • Comprehensive medical, dental, vision, and FSA plans
  • Competitive compensation and 401(k) plan
  • Relocation and immigration support on a case-by-case basis
  • In-office snacks and meals provided
  • Unlimited PTO and company holidays

About the company

Zyphra's research methodology is grounded in methodical, step-by-step approaches to ambitious goals. Both deep research and engineering excellence are equally valued.

Research Engineer -- Vision and Vision-Language Models at Zyphra | JobZoey