Software Architect

The role

You will define the technical direction and own the end-to-end architecture of the SambaStack inference platform. This role involves driving architectural strategy and solving complex problems at the intersection of AI infrastructure and enterprise software.

What you will do

• Own the end-to-end technical architecture of the SambaStack inference platform.
• Define and drive architectural strategy across engineering teams.
• Lead design reviews for major new capabilities and cross-cutting system changes.
• Identify and resolve systemic risks including performance bottlenecks and reliability gaps.
• Establish and evolve architectural standards, patterns, and best practices.
• Partner with ML Engineers, Product Managers, QA, and DevOps to translate requirements into architectural decisions.
• Serve as a technical thought leader and mentor to Software Engineers.
• Evaluate emerging technologies and industry trends to inform the technical roadmap.
• Architect new systems, components, and capabilities for the AI inference space.

Required qualifications

• 12+ years of software engineering experience, including significant time in a role with organization-wide technical influence.
• Proven track record of owning large-scale distributed systems architectures end-to-end from design to production.
• Expertise building backend systems in Python, Go, or Rust.
• Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management.
• Strong command of distributed systems principles: consistency, fault tolerance, observability, and performance at scale.
• Demonstrated experience setting technical direction across multiple teams and driving cross-functional alignment.
• Excellent written and verbal communication skills.

Nice to have

• Deep familiarity with AI inference serving, orchestration, and the infrastructure challenges of LLM workloads at production scale.
• Experience designing systems for custom or novel hardware accelerators (e.g., dataflow architectures, GPUs, TPUs).
• Background in ML application optimization and productionization.
• Experience building cloud-native platforms for enterprise customers with stringent SLA and compliance requirements.
• Familiarity with AI coding assistants and the developer tooling ecosystem.
• Experience at a high-growth AI infrastructure company.

Benefits

• Base salary plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Headspace subscription
• Gympass+ membership
• One Medical membership
• Counseling services with an Employee Assistance Program

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform. The company is building an integrated hardware and software platform to disrupt the AI and high-performance computing space.