Solutions Architect

The role

You will partner with Sales and customers to translate business needs into technical solutions. You will run technical discovery, lead demos, and guide repeatable deployments and proofs of value.

What you will do

• Partner with Sales on customer discovery calls.
• Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
• Own benchmarking and repeatable deployments.
• Handle standard deployment patterns and configurations across many modalities.
• Advise on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
• Drive consistent playbook style deployments for common models and use cases.
• Become a power user of different runtimes such as vLLM, SGLang, and TRT-LLM.
• Drive POC and project execution.
• Scope POCs and keep stakeholders aligned on timeline, deliverables, and next steps.
• Act as the ringleader or project manager for POCs.

Required qualifications

• AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.
• Strong customer-facing communication skills.
• Technical depth to scope solutions, without needing to write production code.
• Ability to script and prototype as needed, including comfort vibe coding to move quickly in technical workflows.

Nice to have

• Experience running or supporting benchmarks for ML inference deployments.
• Familiarity with infrastructure tradeoffs relevant to inference performance and cost.
• Experience serving as a cross-functional technical lead for customer POCs.

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies. They provide a platform that enables companies to bring cutting-edge models into production.