Lambda

Senior Software Enginering - Mk8S/Control Plane

San Francisco Office (Fremont St), Remote. Posted a month ago

The role

You will design, build, and maintain scalable control plane services and custom Kubernetes controllers. You will work on managed orchestration services including Managed Kubernetes and Managed Slurm on Kubernetes to power AI workloads.

What you will do

  • Design, build, and maintain scalable control plane services, operators, and custom Kubernetes controllers
  • Develop automation in Go/Python for end-to-end cluster lifecycle management
  • Build GPU-aware orchestration systems for GPU scheduling and resource allocation
  • Partner with the Network team on networking solutions like CNI integration and high-performance fabrics
  • Write resilient systems that handle failure gracefully across large-scale distributed environments
  • Develop platform services for inference including model serving infrastructure and autoscaling
  • Build internal tools and CLIs for ML/AI teams to deploy and monitor inference services
  • Support and debug production issues through on-call rotation

Required qualifications

  • 6+ years of experience in software engineering
  • Deep understanding of Kubernetes internals: controllers, schedulers, operators, CRDs, CSI, CNI, and extension patterns
  • Solid grasp of distributed systems fundamentals
  • Experience operating the control plane and low-level pieces of large-scale Kubernetes clusters
  • Experience with observability at scale: Prometheus, Grafana, distributed tracing, and building alerting systems
  • Strong programming skills in Go and Python
  • Solid knowledge of Linux systems, networking, containers, and cloud infrastructure

Nice to have

  • Experience building and operating managed Kubernetes services (GKE, EKS, AKS, or similar) or working on Kubernetes control plane components
  • Hands-on experience with NVIDIA's GPU/networking ecosystem: GPU Operator, device plugins, DCGM, MIG, Network Operator, NCCл tuning, or similar
  • Familiarity with HPC and traditional job schedulers (Slurm) and Kubernetes-native batch scheduling (KAI, Volcano, Kueue)
  • Familiarity with GPU, InfiniBand, RDMA, or high-performance computing on Kubernetes
  • Exposure to storage architecture for AI/ML workloads
  • Past contributions to CNCF projects or Kubernetes SIGs

Benefits

  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible paid time off plan

About the company

Lambda is a leader in AI cloud infrastructure serving tens of thousands of customers, ranging from AI researchers to enterprises and hyperscalers. Founded in 2012, the company is building the essential infrastructure for the AI era.

Senior Software Enginering - Mk8S/Control Plane at Lambda | JobZoey