Sambanovasystems

Forward Deployment Engineer

Tokyo Prefecture, Japan. Posted a month ago

The role

The Forward Deployment Engineer will embed with strategic enterprise customers to design, build, and deploy production GenAI applications on SambaNova platforms. This role involves architecting LLM-powered workflows, optimizing AI inference performance, and troubleshooting production issues across model, software, and hardware layers.

What you will do

  • Embed directly with strategic enterprise customers to design, build, and deploy production GenAI applications
  • Architect and implement LLM-powered workflows including RAG pipelines, multi-agent systems, fine-tuning workflows, and coding solutions
  • Optimize AI inference performance on SambaNova hardware
  • Benchmark model throughput, latency, and accuracy
  • Troubleshoot and resolve production issues end-to-end across model, software, and hardware layers
  • Translate customer needs into clear product requirements and engineering feedback
  • Partner with Account Executives and Solutions Engineers to shape technical sales strategy
  • Develop reusable accelerators, reference architectures, and internal playbooks
  • Present technical findings, architecture decisions, and roadmap input at customer executive briefings and internal forums
  • Represent SambaNova at industry conferences and events

Required qualifications

  • 5+ years of hands-on engineering experience
  • Strong record of shipping production AI/ML systems
  • Deep expertise in GenAI application development: LLM orchestration, RAG, agentic frameworks (LangChain, LlamaIndex, DSPy), prompt engineering, and evaluation pipelines
  • Strong foundations in ML fundamentals — model training, fine-tuning, inference optimization, quantization, and performance benchmarking
  • Proficiency in Python
  • Experience deploying AI workloads on cloud infrastructure (AWS, Azure, GCP)
  • Familiarity with containerization, orchestration (Kubernetes, Docker), and MLOps tooling
  • Comfortable engaging directly with customers
  • Bachelor's or graduate degree in Computer Science, Electrical Engineering, Mathematics, Physics, or equivalent practical experience
  • Willingness to travel up to 50% to customer sites

Nice to have

  • working knowledge of C++ or CUDA
  • Experience with AI accelerators or custom silicon (TPUs etc.)
  • CUDA / low-level GPU programming
  • Familiarity with VLLM / SGLang
  • Enterprise AI deployments in regulated industries

Benefits

  • Base salary plus equity
  • 95% premium coverage for employee medical insurance
  • 77% premium coverage for dependents
  • Health Savings Account (HSA) with employer contribution
  • Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
  • Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care
  • Headspace subscription
  • Gympass+ membership
  • One Medical membership
  • Counseling services with an Employee Assistance Program

Before you apply

  • You must submit an application form for each position for which you believe you are qualified

About the company

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. The company is disrupting the AI and high-performance computing space with an integrated hardware and software platform.

Forward Deployment Engineer at Sambanovasystems | JobZoey