Senior Runtime Engineer

The role

You will design and develop high-performance distributed software to orchestrate compute and data pipelines across heterogeneous clusters. The role involves optimizing model execution from data ingestion to distributed execution on cutting-edge hardware platforms.

What you will do

• Design and implement distributed runtime components to manage large-scale execution workloads.
• Develop and optimize high-performance data and communication pipelines.
• Enable scalable execution across multiple compute nodes.
• Collaborate with ML and compiler teams to integrate new model architectures and hardware optimizations.
• Diagnose and resolve complex performance issues using profiling and instrumentation tools.
• Contribute to system design, architecture reviews, and roadmap planning.

Required qualifications

• 3+ years of experience developing high-performance or distributed system software.
• Strong programming skills in C/C++.
• Expertise in multi-threading, memory management, and performance optimization.
• Experience with distributed systems, networking, or inter-process communication.
• Solid understanding of data structures, concurrency, and system-level resource management.
• Proven ability to debug, profile, and optimize code across scales.
• Bachelor’s, Master’s, or equivalent experience in Computer Science, Electrical Engineering, or related field.

Nice to have

• Familiarity with machine learning training or inference pipelines, especially distributed training and large-model scaling.
• Exposure to Python and PyTorch, particularly in the context of model training or performance tuning.
• Experience with compiler internals, custom hardware interfaces, or low-level protocol design.
• Prior work on high-performance clusters, HPC systems, or custom hardware/software co-design.
• Deep curiosity about how to unlock new levels of performance for large-scale AI workloads.

Benefits

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source cutting-edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Job stability with startup vitality.
• Simple, non-corporate work culture that respects individual beliefs.

About the company

Cerebras Systems builds the world's largest AI chip. The company works with leading model labs, global enterprises, and cutting-edge AI-native startups.