Platform Engineer

The role

You will design and maintain systems to keep infrastructure robust, observable, secure, and scalable. You will work on observability systems, infrastructure as a service, and deployment systems for ML workloads.

What you will do

• Building and improving observability systems
• Managing Infrastructure as a Service and CI/CD
• Designing resilient build and deployment systems
• Implementing secure release processes
• Collaborating with ML engineers, DevOps, and infra teams
• Leading incident response, root-cause analysis, and postmortems

Required qualifications

• Experience in high-performance compute environments, such as ML clusters or GPU farms as well as hyperscaler cloud environments (i.e. AWS, GCP, etc.)
• Background in infrastructure as code (i.e. Terraform, Ansible, etc.)
• Familiarity with containers (i.e. Docker, Apptainer) and their integration with scheduling systems (i.e. Kubernetes, Slurm)
• Experience managing run-books, DRP, change management, and general fault tolerance
• Experience with deployment strategies at scale
• Experience designing reliable environments for experimental workloads and reproducible runs
• Knowledge of compliance and audit standards in deployment and system security
• Experience with load testing, fault injection, and chaos engineering to harden systems under stress

Nice to have

• Familiarity with software release engineering for ML/AI systems
• Prior work supporting ML/AI infrastructure, including GPU management and workload optimization
• Exposure to backend development for ML model serving (i.e. vLLM, Ray, SGLang, Triton)

Benefits

• Comprehensive medical, dental, vision, and FSA plans
• Competitive compensation and 401(k) plan
• Relocation and immigration support on a case-by-case basis
• In-office snacks and meals provided
• Unlimited PTO and company holidays

About the company

Zyphra is an artificial intelligence company based in San Francisco, California.