Site Reliability Engineer, Platform Infrastructure (Foundations)

The role

You will design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments. You will work on the control plane and data plane to power Anyscale's cloud platform.

What you will do

• Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments
• Optimize control plane components for large-scale, distributed AI/ML workloads
• Build intelligent scheduling and resource management systems for heterogeneous compute clusters
• Develop features to enhance reliability, performance, scalability, and observability of Ray workloads
• Support and optimize accelerator integration
• Handle container image management and dependency resolution
• Participate in code reviews, design and architecture discussions
• Provide on-call support to troubleshoot infrastructure issues
• Collaborate with distributed systems and machine learning experts

Required qualifications

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• 3+ years of experience writing high-quality production code
• Hands-on experience in building and maintaining highly available, scalable, and performant distributed system
• Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
• Deep understanding of networking, security, and authentication mechanisms in cloud environment
• Familiarity with observability stacks (Prometheus, Grafana etc)
• Proficiency in Go and Python
• Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)

About the company

Anyscale is commercializing Ray, an open-source project for scalable machine learning. The company aims to democratize distributed computing for software developers.