Platform & Infra Engineer

The role

You will build and maintain an API platform for inference. You will work across different levels in the inference system with depth in distributed systems and networking.

What you will do

• Define APIs for a new kind of AI inference experience
• Create robust infrastructure for serving inference across multiple cloud providers
• Define abstractions for billing and business logic needs
• Work on exposing new model features to users

Required qualifications

• Responsible, ownership-inclined, and a team player
• Experience designing storage abstractions for scaled backend systems
• Experience designing resilient systems and improving on-call experience on production systems
• Collaborate well with others on technical and product design
• Mission aligned and excited to go all-in
• Love being part of a team

Nice to have

• Have previously built big things
• 5+ years of professional software engineering experience (3+ years of infra/backend) with a team with rigorous engineering standards
• Have shipped backend services at scale with continuous delivery and uptime SLAs of at least 3 9s
• Have designed and operated a developer-facing API service
• Have experienced LLMs' capabilities and limitations from implementing them in the past

Benefits

• 100% covered health insurance
• Daily lunch and dinner
• Visa sponsorships
• 401K plans

About the company

TypeSafe is an AI lab pushing frontier model intelligence with System One Models. It is a small, fast team backed by a $870M Series A led by a16z.