AI Engineer, Model Quality and Performance

The role

You will own model quality and performance for Cerebras' inference offerings. You will design eval suites using AI agents, build custom evals for customers, and automate eval execution with AI-driven pipelines.

What you will do

• Design eval suites with AI agents in the loop.
• Build custom evals for target customers by orchestrating AI agents.
• Automate eval execution end-to-end with AI-driven pipelines.
• Build automations to forecast and benchmark model performance.
• Build product-quality tooling that synthesizes quality and performance data.

Required qualifications

• Experience building AI agents.
• Strong math/stats background.
• Comfort with Docker, Git, and the standard automation stack.
• A taste for tooling design.

Nice to have

• Performance-tuning experience on custom silicon, GPUs, or FPGAs.
• Experience designing evals for agentic / coding / long-context / multimodal use cases.
• Familiarity with open-source eval frameworks (EvalScope, lm-eval-harness, etc.).
• Experience building AI agents.

Benefits

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source cutting-edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Job stability with startup vitality.
• Simple, non-corporate work culture that respects individual beliefs.

About the company

Cerebras Systems builds the world's largest AI chip. The company works with leading model labs, global enterprises, and cutting-edge AI-native startups.