Software Engineer - Dedicated Inference

The role

You will shape the developer experience for deploying and operating AI workloads in production. You will build tools including CLI, SDKs, APIs, observability, and debugging workflows.

What you will do

• Implement new features and products for the team
• Design ergonomic APIs and abstractions to solve customer problems
• Fix bugs and resolve customer issues with urgency
• Work across the stack including React Components and Kubernetes Pods
• Work closely with the product and forward deployed engineering teams to develop and drive new product ideas

Required qualifications

• Bachelor's degree or higher in Computer Science or related field
• Proficient coding abilities in one or more popular programming or scripting languages
• Familiarity with web applications & databases
• Good taste in product, particularly developer-oriented tools
• Interest in ML/AI infrastructure and willingness to learn
• Strong collaboration and communication skills

Nice to have

• Python, Go, or JavaScript proficiency is a plus

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies. They enable companies operating at the frontier of AI to bring cutting-edge models into production.