Member of Technical Staff, Exceptional Generalist (Remote)

The role

You will work across the entire vLLM stack from low-level GPU kernels to high-level distributed systems. You will optimize CUDA kernels, design distributed orchestration systems, and implement new model architectures.

What you will do

• Work across the entire vLLM stack
• Optimize CUDA kernels
• Design distributed orchestration systems
• Implement new model architectures
• Push the boundaries of LLM and diffusion model serving
• Write low-level kernels and optimizations
• Build distributed systems for inference at global scale
• Build the operational backbone for cluster management, deployment automation, and production monitoring

Required qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, or similar
• Demonstrated ability to work autonomously and drive projects to completion without close supervision
• Excellent asynchronous communication skills and ability to collaborate effectively across time zones
• Strong track record of shipping high-impact work in complex technical environments
• Deep expertise in at least one of: systems programming, GPU/accelerator programming, distributed systems, or ML infrastructure
• Strong in at least two: CUDA kernels or equivalent (Triton, TileLang, Pallas) with deep understanding of GPU architecture
• Strong in at least two: High-performance distributed systems in Rust, Go, or C++
• Strong in at least two: Python with PyTorch internals and LLM inference systems (vLLM, TensorRT-LLM, SGLang)
• Strong in at least two: Kubernetes, container orchestration, and infrastructure-as-code at scale
• Strong in at least two: Transformer architectures, KV-cache memory management, and model serving

Nice to have

• Contributions to vLLM or other major open-source ML/systems projects
• Experience with multiple accelerator platforms (NVIDIA, AMD, TPU, Intel)
• Knowledge of quantization techniques, ML-specific kernel optimization, or compiler technologies
• Track record of improving system reliability and performance at scale
• Written widely-shared technical blogs or impactful side projects in the ML infrastructure space

Benefits

• competitive compensations (salary + equity)
• health coverage where applicable

Before you apply

• We sponsor visas on a case-by-case basis

About the company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware.