Member of Technical Staff - GPU Infrastructure

The role

This customer-facing role involves designing GPU cluster architectures and implementing high-performance infrastructure. You will deploy orchestration systems, optimize GPU utilization, and provide technical support for large-scale workloads.

What you will do

• Partner with clients to design optimal GPU cluster architectures
• Create technical proposals and capacity planning for clusters
• Develop deployment strategies for LLM training, inference, and HPC workloads
• Present architectural recommendations to stakeholders
• Deploy and configure orchestration systems including SLURM and Kubernetes
• Implement high-performance networking with InfiniBand, RoCE, and NVLink
• Optimize GPU utilization, memory management, and inter-node communication
• Configure parallel filesystems for optimal I/O performance
• Tune system performance from kernel parameters to CUDA configurations
• Serve as primary technical escalation point and provide 24/7 on-call support

Required qualifications

• 3+ years hands-on experience with GPU clusters and HPC environments
• Deep expertise with SLURM and Kubernetes in production GPU settings
• Proven experience with InfiniBand configuration and troubleshooting
• Strong understanding of NVIDIA GPU architecture, CUDA ecosystem, and driver stack
• Experience with infrastructure automation tools (Ansible, Terraform)
• Proficiency in Python, Bash, and systems programming
• Track record of customer-facing technical leadership
• NVIDIA driver installation and troubleshooting (CUDA, Fabric Manager, DCGM)
• Container runtime configuration for GPUs (Docker, Containerd, Enroot)
• Linux kernel tuning and performance optimization
• Network topology design for AI workloads
• Power and cooling requirements for high-density GPU deployments

Nice to have

• Experience with 1000+ GPU deployments
• NVIDIA DGX, HGX, or SuperPOD certification
• Distributed training frameworks (PyTorch FSDP, DeepSpeed, Megatron-LM)
• ML framework optimization and profiling
• Experience with AMD MI300 or Intel Gaudi accelerators
• Contributions to open-source HPC/AI infrastructure projects

Benefits

• Cash compensation of $150-300k with significant equity incentives
• Flexible work arrangement (remote or San Francisco office)
• Full visa sponsorship and relocation support
• A professional development budget for courses and conferences
• Regular team off-sites and conference attendance

About the company

Prime Intellect is building the open superintelligence stack, providing infrastructure for frontier AI labs. The company has raised $150M in total funding from investors including Founders Fund, Radical Ventures, and NVIDIA.