Senior Principal Runtime Engineer

The role

This person will build a high-performance, distributed, and scalable software execution environment for SambaNova SambaStack and Cloud platforms. They will work on runtime stacks to support AI, ML, and scientific applications in high-performance distributed systems.

What you will do

• Develop new and enhanced features to support high-performance, scalable ML inference and training applications
• Create drivers and kernels for next generation silicon
• Eliminate networking bottlenecks to enable high performance distributed systems
• Develop user-space libraries for high performance and high utilization of HW resources
• Build user-facing tools for analysis, job and HW management, profiling, and debugging for Datascale systems
• Collaborate cross-functionally with Hardware, ML Application, Compiler, and DevOps teams

Required qualifications

• B.S. in Computer Science, Engineering, or related field
• 5+ years of software engineering experience, often with emphasis on distributed systems, networking, or cloud infrastructure
• Proven experience building, testing, and tuning software for distributed, high-performance systems
• In-depth knowledge of user libraries, and runtime stacks
• Solid understanding of Switching and Routing and ability to configure and debug switches and routers for maximum application performance
• Significant experience with RDMA and RoCE networking stacks, such as RDMA based verbs and congestion management
• Hands-on experience with kernel drivers and system-level software that directly interfaces with hardware
• Expertise in designing and optimizing systems that handle massive parallel workloads, including machine learning training and inference tasks
• Deep understanding of hardware-software interaction, including registers, device memory management, and the intricacies of accelerator design
• Familiarity with distributed systems architecture, including networking, communication protocols, and the challenges of scaling compute resources efficiently
• Hands-on experience with software development tools such as Git, Jenkins, and Jira
• Ability to work at the intersection of hardware and software, designing systems that optimize both performance and reliability

Nice to have

• Experience working with ASIC accelerators is highly desirable
• Experience designing or working closely with custom hardware accelerators (ASICs, FPGAs, etc.) and understanding low-level interactions
• Knowledge of SDN, DPDK, SONiC, or modern networking frameworks and background with distributed communication libraries (e.g., UCX, MPI, NCCL)
• Familiarity with deploying high-performance systems in distributed, cloud, or data center environment

Benefits

• Base salary, plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Full subscription to Headspace
• Gympass+ membership with access to physical gyms
• One Medical membership
• Counseling services with an Employee Assistance Program

Before you apply

• You must submit an application form for each position for which you believe you are qualified

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. Its technology is centered on the RDU (Reconfigurable Dataflow Unit).