Lambda

Senior Software Engineer - Storage Control Plane

San Francisco Office (Fremont St), Remote. Posted 3 months ago

The role

You will develop and implement next-generation storage software. You will build a scalable and resilient storage control plane to power AI and machine learning infrastructure.

What you will do

  • Design and build a vendor-agnostic control plane to provision, scale, heal, and meter storage.
  • Define the internal abstraction layer to hide vendor-specific APIs and telemetry formats.
  • Build reconciliation-loop and CRD-based orchestration using Kubernetes controllers, operators, and custom schedulers.
  • Own multi-tenant isolation including namespace partitioning, per-tenant QoS, and credential lifecycle.
  • Design the capacity and placement engine.
  • Instrument SLI/SLO definitions, performance regression detection, and the observability pipeline.

Required qualifications

  • Bachelor's or Master's degree in Computer Science or a related field.
  • 5+ years of experience in software development for storage systems.
  • Proven experience with distributed systems programming and concepts such as load balancers, data-durability, consensus algorithms, fault tolerance, and data consistency.
  • Strong programming skills in languages such as C, C++, Go, or Python.
  • Experience with Linux kernel internals and system-level programming.
  • Experience with one or more storage protocols (e.g. S3, NFS) and file systems such as Ceph, DAOS, or similar.
  • Familiarity with containerization technologies like Docker and Kubernetes and running production workloads in these environments.
  • Familiarity with CI/CD and QA practices for distributed systems development environments.

Nice to have

  • Experience with AI/ML workloads and the unique storage challenges they present.
  • Knowledge of data center networking and high-speed interconnects (e.g., InfiniBand, RoCE).
  • Experience with performance tuning and optimization of storage systems.
  • Familiarity with hardware acceleration technologies, specifically GPUs and DPUs.
  • Production experience with VAST Data, WEKA, DDN, Pure, NetApp, or IBM Storage Scale.
  • Ceph at 100 PB+ in HPC or AI environments.
  • CXL memory pooling, computational storage, ZNS SSDs, EDSFF.
  • Published or presented at SNIA SDC, FAST, USENIX ATC, LSFMM+BPF, OCP, SC, or similar.

Benefits

  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible paid time off plan

About the company

Lambda is a leader in AI cloud infrastructure serving tens of thousands of customers. Founded in 2012, the company has 500+ employees and is growing fast.

Senior Software Engineer - Storage Control Plane at Lambda | JobZoey