Cerebras

Software Engineer, Inference Platform

Sunnyvale, CA. Posted 4 months ago

The role

This person will design, develop, test, and maintain production software for the Inference Platform. They will work on the orchestration layer that runs inference on datacenter clusters.

What you will do

  • Design, develop, test, and maintain production software.
  • Help shape the technical direction for the Inference Platform.
  • Architect active-active systems with rapid failover and graceful degradation.
  • Drive system-level improvements in latency, throughput, capacity efficiency, and resilience.
  • Write and review production code in important parts of the platform.
  • Make high-consequence architectural decisions.
  • Lead on hard production issues and cross-system bottlenecks.
  • Drive observability, incident response, capacity planning, and post-incident improvement.
  • Partner with ML, Product, Infrastructure, and Cloud teams to translate requirements into system designs.

Required qualifications

  • 3+ years of experience in software engineering, with experience building and operating large-scale distributed systems or cloud infrastructure.
  • Experience in distributed systems, ideally with Kubernetes.
  • Experience building highly available, latency-sensitive systems at scale.
  • Experience with security (certificates, TLS, mTLS).
  • Experience optimizing latency, throughput, and efficiency in high-QPS systems.
  • Strong proficiency in backend or systems languages such as Go or C++.

Nice to have

  • Experience with TTFT and tail-latency reduction is a strong plus.
  • Experience with ML inference infrastructure, model serving systems, or GPU-accelerated workloads.

Benefits

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Simple, non-corporate work culture that respects individual beliefs.

About the company

Cerebras Systems builds the world's largest AI chip. The company works with leading model labs, global enterprises, and cutting-edge AI-native startups.