Baseten

Software Engineer - Networking (Agent Infra)

San Francisco, Remote. Posted 18 days ago

The role

You will design and build a user-space, VPP-based data plane to connect microVM sandboxes to services and the internet. You will build multi-tenant virtual private networking, overlays, and programmable APIs for agentic infrastructure.

What you will do

  • Design and build the user-space, VPP-based data plane
  • Build multi-tenant virtual private networking and overlays across regions
  • Expose the network as a programmable API
  • Cut latency and raise connection scale for agent traffic
  • Build routing for nearest region requests and sandbox state changes
  • Build secure ingress and egress for sandboxes
  • Build L7 proxies for inspection, filtering, and auditing
  • Own per-sandbox addressing and network isolation
  • Build observability for the packet path and debug production issues
  • Work closely with compute, storage, GPU infrastructure, and datacenter teams

Required qualifications

  • Experience with user-space packet processing (DPDK, VPP, or similar) or virtualized network functions (VNF/NFV)
  • Experience building multi-tenant networking in production (VXLAN, GENEVE, VRF)
  • Experience building a software-defined network, overlay network, or packet-processing data plane in production
  • Strong systems programming in Rust, Go, and/or C/C++
  • Experience building cloud networking as the provider
  • Solid grounding in TCP/IP and routing
  • Experience building or operating proxies, load balancers, or L4/L7 gateways at scale
  • Experience debugging latency and throughput problems with packet captures, tracing, and profiling
  • Ability to move fast and own problems end to end on a small team

Nice to have

  • Experience with VPP / FD.io
  • Experience with GENEVE or VXLAN overlays and EVPN
  • Linux kernel networking: eBPF/XDP, netfilter or nftables, network namespaces
  • Familiarity with virtual machine networking: virtio-net, vhost, TAP devices, or networking for Firecracker or Cloud Hypervisor
  • Experience running IPv6 at scale
  • Background in telecom user-plane or 5G core networking, or in low-latency trading networks
  • Experience with multi-region traffic routing, anycast, or BGP
  • Experience with TLS termination, DNS, and egress security controls

Benefits

  • Competitive compensation, including meaningful equity
  • 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
  • Flexible PTO policy including company wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k) (U.S. only)
  • Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. The company recently raised a $1.5B Series F.

Software Engineer - Networking (Agent Infra) at Baseten | JobZoey