Member of Technical Staff - GPU Infrastructure

The role

This role involves building and scaling a multi-tenancy provisioning and virtualization solution for a GPU Cloud Marketplace. You will transform raw GPUs from global suppliers into a programmable, orchestrated pool for AI developers and researchers.

What you will do

• Build and scale Hyperbolic's GPU Cloud Marketplace
• Build a multi-tenancy provisioning and virtualization solution
• Transform raw GPUs from diverse global suppliers into a programmable, orchestrated pool
• Build the core orchestration layer
• Work with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations

Required qualifications

• Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
• Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimizatio
• Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementat
• Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
• Proficiency with API design and cloud-init for automated provisioning and configuration
• Solid understanding of GPU architecture, CUDA, and GPU compute optimization
• Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
• Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
• Experience building and scaling cloud infrastructure or distributed systems in production environments

Nice to have

• Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)
• Experience with distributed storage systems such as Ceph, Weka, or VAST Data

About the company

Hyperbolic makes global AI compute liquid by bringing fragmented, heterogeneous GPU capacity together into one unified, productive platform. They turn GPU capacity into productive infrastructure for neocloud.