Software Engineer - GPU Kernels

The role

You will design and implement high-performance GPU kernels for machine learning operations. You will optimize code using CUDA and architecture-specific techniques to improve model performance.

What you will do

• Design and implement high-performance GPU kernels for key ML operations
• Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques
• Apply advanced performance optimization methods
• Implement cutting-edge features like quantization, sparsity, and compute/communication overlap
• Identify and resolve performance bottlenecks using profiling tools
• Collaborate with research teams to productionize theoretical advancements
• Contribute to internal and open-source GPU libraries
• Present technical contributions at industry conferences

Required qualifications

• Strong understanding of GPU architecture and programming paradigms
• Knowledge of memory hierarchy
• Knowledge of thread/block/grid organization
• Knowledge of synchronization techniques and race condition mitigation
• Proficient in C++ and GPU performance profiling tools
• Knowledge of CUDA C++ API
• Knowledge of memory access patterns and bandwidth optimization
• Knowledge of numerical precision and quantization strategies
• Knowledge of modern GPU features

Nice to have

• Experience with Transformer models and attention optimization (e.g., Flash Attention)
• Familiarity with GPU kernel libraries: Cutlass, Triton, Thrust, CUB
• Background in GEMM tuning and distributed/multi-GPU compute
• Contributions to open-source GPU projects
• Research publications or conference presentations on GPU performance

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. The company recently raised a $1.5B Series F.