Senior AI Performance Engineer

The role

You will optimize and scale state-of-the-art foundation models on the SambaNova reconfigurable dataflow platform. You will work across compiler, runtime, and hardware layers to improve throughput, latency, and efficiency.

What you will do

• Bring up and optimize cutting-edge foundation models on the SambaNova platform through the SambaNova software stack.
• Profile and enhance model performance across compiler, runtime, and hardware layers.
• Collaborate with machine learning, compiler, runtime, and hardware teams.
• Integrate advances in model architecture, quantization, scheduling, and memory optimization.
• Develop robust, scalable, and efficient end-to-end inference solutions.
• Identify performance bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems.

Required qualifications

• Bachelor's or higher degree in computer science, electrical engineering, or a related field (e.g., applied mathematics, physics, or statistics).
• 3+ years of experience in deep learning model development and performance optimization, compiler, runtime, or kernel-level optimization, or software–hardware co-design or systems performance tuning.
• Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
• Experience with at least one major ML framework — PyTorch, TensorFlow, or JAX.
• Demonstrated ability to analyze and optimize performance in real-world ML pipelines.

Nice to have

• Hands-on experience with LLM or multimodal model training and inference.
• Background in large-scale distributed training, continuous batching, and high-throughput inference systems.
• Familiarity with quantization, graph optimization, kernel fusion, and model partitioning.
• Experience with frameworks such as DeepSpeed, Megatron, vLLM, or TensorRT.
• Strong GPU programming skills (CUDA, Triton, or OpenCL).
• Experience with cuDNN, cuBLAS, or similar libraries is a plus.
• Knowledge of memory hierarchy optimization, caching, and scheduling for large-scale model execution.
• Publication record or open-source contributions in ML systems or performance optimization is a plus.

Benefits

• Base salary plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Full subscription to Headspace
• Gympass+ membership with access to physical gyms
• One Medical membership
• Counseling services with an Employee Assistance Program

Before you apply

• You must submit an application form for each position for which you believe you are qualified.

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide.