Engineering Manager, Runtime - Storage

The role

You will lead a team of 5 to 10 systems engineers building storage products for the Baseten Delivery Network. You will guide the architecture of tiered caching and weight delivery to improve cold starts for AI inference workloads.

What you will do

• Hire and grow a team of 5 to 10 systems engineers
• Run the team's planning and delivery
• Provide regular coaching, feedback, and career development support
• Own on-call health for the team's services
• Guide the architecture and evolution of the Baseten Delivery Network
• Shape storage products tailored to Baseten's workloads
• Oversee the on-host side of delivery
• Own reliability of the delivery path as a measured outcome
• Make the delivery path work across heterogeneous clusters and cloud providers
• Review designs and code and take on hands-on work

Required qualifications

• Experience managing a team of engineers in a systems, infrastructure, or storage context, including hiring and performance management
• Hands-on background in distributed storage systems, content-addressable storage, or large-scale caching infrastructure
• Strong systems programming background in Go, Rust, and/or C/C++
• Working knowledge of the Linux storage stack: filesystems, the page cache, block devices, and mounts
• Understanding of how container images are structured, stored, and delivered at scale
• Strong written and verbal communication skills

Nice to have

• Contributions to containerd/containerd, snapshotter projects (stargz, soci, nydus, overlaybd), distribution/distribution, or closely related open-source projects
• Familiarity with lazy-loading snapshotters or peer-to-peer image distribution
• Experience with EROFS, FUSE, ublk, or io_uring
• Experience building or operating CDN, object storage, or large-scale caching infrastructure
• Experience running storage services on Kubernetes

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies. They build a platform that enables companies to bring cutting-edge models into production.