Member of Technical Staff, Video Data & Model Evaluation

The role

You will shape the data and evaluation strategies behind video generation models. You will own the full data lifecycle including defining requirements, building datasets, and evaluating model outputs.

What you will do

• Define quality standards for video generation.
• Evaluate model iterations and analyze failure patterns.
• Own end-to-end training data projects.
• Develop labeling systems for dataset segmentation and quality filtering.
• Design annotation and captioning standards.
• Create and evaluate synthetic-data workflows.
• Develop automated annotation and filtering workflows.
• Build structured model evaluation processes.
• Establish feedback loops between evaluation and data strategy.
• Train and calibrate annotation teams and external data partners.

Required qualifications

• Hands-on experience in data strategy, dataset development, annotation, or model evaluation for generative image, video, or multimodal models.
• Experience supporting model development across continued training, supervised fine-tuning, post-training, or evaluation.
• Strong understanding of generative media tasks, including image and video generation, multimodal generation, and instruction-based editing.
• Experience developing labeling taxonomies, annotation guidelines, captioning standards, quality thresholds, and evaluation frameworks.
• Strong visual judgment and the ability to translate subjective quality expectations into measurable data and evaluation standards.
• Experience managing large-scale data-production or annotation projects and collaborating with research, engineering, creative, and external partner teams.

Nice to have

• Familiarity with automated captioning, synthetic-data generation, vision-language models, prompt design, Python, SQL, or other data and workflow automation tools

Benefits

• Competitive salary
• Generous company equity
• Personal time off
• Paid holidays
• Health insurance
• Global travel insurance
• Monthly spending stipend: $500 (~S$635)
• Equipment: All equipment needed for your home office

About the company

Cantina Labs is a social AI company developing a suite of advanced real-time models. They build and power ecosystems through their flagship social AI platform, Cantina.