Software Engineer, Model Routing & Inference

The role

You will build the inference platform that powers AI interactions. The team owns the full inference path to make AI faster, more reliable, and more cost-effective.

What you will do

• Build and evolve the inference gateway
• Design intelligent cross-provider failover
• Design routing backpressure and admission control

Required qualifications

• Experience building high-throughput, low-latency distributed systems
• Bachelor's degree in computer science, engineering, math, or scientific discipline; OR 2+ years of professional experience building software in lieu of a degree

Nice to have

• Comfortable reasoning about cost/performance tradeoffs at scale
• Strong software engineering fundamentals
• Enjoying shipping production systems that handle millions of requests

Benefits

• Equity
• Comprehensive medical, vision, and dental coverage
• Access to a 401(k) retirement plan
• Short & long-term disability insurance
• Life insurance
• Various other discounts and perks

Before you apply

• If there appears to be a fit, we'll reach out to schedule 2-3 short technicals
• After, we'll schedule an onsite in our office, where you'll work on a small project, discuss ideas, and meet the team

About the company

SpaceXSI is building Super Intelligence to help humanity understand the universe. They are building the full Super Intelligence stack from Colossus supercomputers to Grok models and applications.