Inference Systems Performance Architect

The role

You will architect end-to-end inference performance by building workload capture, benchmarking, and performance modeling capabilities. You will analyze how requests move through tokenization, prefill, decode, and fabric to size deployments against customer SLOs.

What you will do

• Define and drive technical strategy for inference-systems performance
• Build workload-capture and agentic-benchmarking capability
• Own the performance-modeling and simulation practice
• Drive tooling for end-to-end profiling of distributed inference pipelines
• Serve as the senior technical voice across model-optimization, systems, hardware, and product
• Represent SambaNova's performance story to customers and partners
• Mentor principal and senior engineers
• Drive resolution of ambiguous, novel challenges

Required qualifications

• B.S. in Computer Science, Computer Engineering, or Related Field
• 12+ years of experience in performance engineering
• Demonstrated record of technical leadership on large-scale, complex systems
• Deep expertise in end-to-end performance analysis of distributed systems
• Proven command of realistic workload generation, simulation, and performance modeling
• Ability to enter an unfamiliar domain and apply core performance methods
• Ability to lead cross-functional efforts and mentor senior engineers
• Experience representing an organization to customers and partners
• Track record of independently delivering high-complexity, high-ambiguity work

Nice to have

• M.S. or PHD in Computer Science, Computer Engineering, or Related Field
• Direct experience with LLM inference serving - continuous batching, prompt/KV caching, prefill/decode disaggregation, tail-latency SLOs
• Familiarity with inference simulation frameworks or agentic benchmarking efforts
• A public technical voice - talks, writing, or community presence on systems performance

Benefits

• Base salary plus equity
• 95% premium coverage for employee medical insurance
• 77% premium coverage for dependents
• Health Savings Account (HSA) with employer contribution
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
• Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
• Headspace subscription
• Gympass+ membership
• One Medical membership
• Counseling services with an Employee Assistance Program

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide.