Director/Sr. Manager, AI Inference Model Scaling

The role

You will build and scale the Inference Model Scaling organization. You will define technical vision and organizational strategy for a globally distributed team responsible for enabling foundation models on Cerebras hardware.

What you will do

• Define the technical roadmap and strategy for the team.
• Establish technical direction across multiple teams and engineering leaders.
• Lead design reviews and establish engineering standards.
• Drive support for emerging LLM architectures and inference workloads.
• Hire, mentor, and grow a high-performing engineering team.
• Develop future technical leaders and managers.
• Drive organizational planning, headcount strategy, and investment priorities.
• Foster a strong engineering culture focused on execution, quality, and innovation.
• Scale engineering processes while maintaining execution velocity.
• Partner with Cloud Platform, ML, and Hardware teams for service enablement.

Required qualifications

• BS, MS, or PhD in Computer Science, Computer Engineering or related field.
• 12+ years building compiler, ML systems, or infrastructure software.
• 5+ years leading engineering teams.
• Deep experience with modern compiler infrastructure (LLVM, MLIR, XLA, TVM, Torch FX, or similar).
• Strong understanding of graph compilation and optimization.
• Experience with Python and C++.
• Experience delivering production-quality software.
• Strong communication and cross-functional leadership skills.

Nice to have

• Experience building compiler frontends for AI accelerators.
• Experience supporting PyTorch, JAX, TensorFlow, or ONNX.
• Experience with LLM inference or training systems.
• Familiarity with distributed compilation.
• Experience working with hardware architects.
• Experience leading teams through rapid growth.

Benefits

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source cutting-edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Enjoy job stability with startup vitality.
• Simple, non-corporate work culture that respects individual beliefs.

About the company

Cerebras Systems builds the world's largest AI chip. The company works with leading model labs, global enterprises, and cutting-edge AI-native startups.