Software Architect - SambaRack

The role

You will design and build the software architecture for the SambaRack platform. This role focuses on building rack-scale hardware management and infrastructure software that operates in direct contact with hardware.

What you will do

• Own the end-to-end technical architecture of the SambaRack infrastructure and management platform.
• Define and drive architectural strategy across engineering teams.
• Lead design reviews for hardware-software integration points and infrastructure services.
• Identify and resolve systemic risks including performance bottlenecks and reliability gaps.
• Establish and evolve architectural standards, patterns, and best practices.
• Partner with Hardware Engineering, DevOps, QA, and Product teams.
• Serve as a technical thought leader and mentor.
• Evaluate emerging technologies and industry trends to inform the platform's technical roadmap.
• Architect new systems, components, and capabilities for the AI inference space.

Required qualifications

• 12-15 years of software engineering experience
• Strong experience architecting infrastructure, systems, or platform software
• Solid programming experience in Go, Rust, Python, or C/C++
• Strong understanding of Linux, networking, concurrency, and distributed systems
• Experience designing reliable backend or control-plane services for production systems
• Experience with hardware management systems such as BMCs, Redfish, IPMI, or OpenBMC
• Experience with monitoring, telemetry, or observability systems for infrastructure platforms
• Excellent problem-solving skills and attention to detail
• Ability to collaborate across cross-functional teams
• Knowledge of software development best practices and coding standards

Nice to have

• Experience with rack management, server management, or bare-metal infrastructure platforms
• Experience with Prometheus, Grafana, and metrics exporter design
• Familiarity with fleet management, diagnostics systems, and hardware health monitoring
• Experience supporting enterprise or air-gapped deployments
• Solid understanding of Kubernetes, Helm Charts, and Kubernetes ecosystem
• Experience designing scalable infrastructure and distributed systems
• Familiarity with telemetry systems and infrastructure observability tooling

Benefits

• Base salary plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Headspace subscription
• Gympass+ membership
• One Medical membership
• Counseling services with an Employee Assistance Program

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. The company builds products including SambaRack, a rack-scale AI infrastructure system, and SambaStack, an inference serving platform.