Researcher, Evals

The role

You will design evaluation frameworks to measure how models reason, remember, and interact. You will work at the intersection of research, product, and infrastructure to develop metrics, systems, and studies.

What you will do

• Identify and define key model capabilities and behaviors for next-generation model evals
• Develop and implement new evaluation pipelines with robust statistical analysis and clear reporting
• Partner with model training and research teams to embed evaluation systems into development loops
• Prototype new user studies and behavioral experiments

Required qualifications

• Experience designing or implementing evaluation frameworks for generative models (audio, text, or multimodal)
• Strong technical and analytical skills
• Ability to translate open-ended research ideas into production-ready systems
• Creativity in defining novel quantitative metrics for subjective or behavioral qualities
• Excitement for building evaluation systems that bridge research and real-world use
• Curiosity and rigor

Nice to have

• Understanding of model alignment concepts and evaluation approaches

Benefits

• Competitive base salary
• Attractive equity package
• Fully covered medical insurance
• Dental and vision for you and your family
• 9 weeks paternity leave
• 12 weeks maternity leave
• 401(k)
• Monthly commuter allowance
• Flexible PTO
• Lunch, dinner and plenty of snacks provided daily
• Your own personal Yoshi

Before you apply

• Visa sponsorship is provided and assessed on a case-by-case basis
• Cartesia participates in E-Verify and will provide Form I-9 information to confirm employment eligibility after hire

About the company

Cartesia aims to architect AI that learns from and interacts with the world like humans do. The founding team met as PhDs at the Stanford AI Lab and invented State Space Models.