Software Architect - SambaStack

The role

You will define the technical direction of the SambaStack inference platform. You will own cross-cutting architectural decisions to meet enterprise AI workload demands.

What you will do

• Own the end-to-end technical architecture of the SambaStack inference platform.
• Define and drive architectural strategy across engineering teams.
• Lead design reviews for major new capabilities and cross-cutting system changes.
• Identify and resolve systemic risks like performance bottlenecks and reliability gaps.
• Establish and evolve architectural standards, patterns, and best practices.
• Partner with ML Engineers, Product Managers, QA, and DevOps to translate requirements.
• Serve as a technical thought leader and mentor.
• Evaluate emerging technologies and industry trends.
• Architect new systems, components, and capabilities for the AI inference space.

Required qualifications

• 12+ years of software engineering experience, including significant time in a role with organization-wide technical influence.
• Proven track record of owning large-scale distributed systems architectures end-to-end from design to production.
• Expertise building backend systems in Python, Go, or Rust.
• Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management.
• Strong command of distributed systems principles: consistency, fault tolerance, observability, and performance at scale.
• Demonstrated experience setting technical direction across multiple teams and driving cross-functional alignment.
• Excellent written and verbal communication skills.
• Track record of mentoring more junior engineers and elevating team-wide engineering quality.

Nice to have

• Deep familiarity with AI inference serving, orchestration, and the infrastructure challenges of LLM workloads at production scale.
• Experience designing systems for custom or novel hardware accelerators (e.g., dataflow architectures, GPUs, TPUs).
• Background in ML application optimization and productionization.
• Experience building cloud-native platforms for enterprise customers with stringent SLA and compliance requirements.
• Familiarity with AI coding assistants and the developer tooling ecosystem.
• Experience at a high-growth AI infrastructure company.

Benefits

• Base salary plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Full subscription to Headspace
• Gympass+ membership with access to physical gyms
• One Medical membership
• Counseling services with an Employee Assistance Program

Before you apply

• You must submit an application form for each position for which you believe you are qualified.

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. The company uses RDU (Reconfigurable Dataflow Unit) technology to power its platform.