Lambda
Senior Software Engineer - Storage Control Plane
San Francisco Office (Fremont St), Remote. Posted 3 months ago
The role
You will develop and implement next-generation storage software. You will build a scalable and resilient storage control plane to power AI and machine learning infrastructure.
What you will do
- Design and build a vendor-agnostic control plane to provision, scale, heal, and meter storage.
- Define the internal abstraction layer to hide vendor-specific APIs and telemetry formats.
- Build reconciliation-loop and CRD-based orchestration using Kubernetes controllers, operators, and custom schedulers.
- Own multi-tenant isolation including namespace partitioning, per-tenant QoS, and credential lifecycle.
- Design the capacity and placement engine.
- Instrument SLI/SLO definitions, performance regression detection, and the observability pipeline.
Required qualifications
- Bachelor's or Master's degree in Computer Science or a related field.
- 5+ years of experience in software development for storage systems.
- Proven experience with distributed systems programming and concepts such as load balancers, data-durability, consensus algorithms, fault tolerance, and data consistency.
- Strong programming skills in languages such as C, C++, Go, or Python.
- Experience with Linux kernel internals and system-level programming.
- Experience with one or more storage protocols (e.g. S3, NFS) and file systems such as Ceph, DAOS, or similar.
- Familiarity with containerization technologies like Docker and Kubernetes and running production workloads in these environments.
- Familiarity with CI/CD and QA practices for distributed systems development environments.
Nice to have
- Experience with AI/ML workloads and the unique storage challenges they present.
- Knowledge of data center networking and high-speed interconnects (e.g., InfiniBand, RoCE).
- Experience with performance tuning and optimization of storage systems.
- Familiarity with hardware acceleration technologies, specifically GPUs and DPUs.
- Production experience with VAST Data, WEKA, DDN, Pure, NetApp, or IBM Storage Scale.
- Ceph at 100 PB+ in HPC or AI environments.
- CXL memory pooling, computational storage, ZNS SSDs, EDSFF.
- Published or presented at SNIA SDC, FAST, USENIX ATC, LSFMM+BPF, OCP, SC, or similar.
Benefits
- Generous cash & equity compensation
- Health, dental, and vision coverage for you and your dependents
- Wellness and commuter stipends for select roles
- 401k Plan with 2% company match (USA employees)
- Flexible paid time off plan
About the company
Lambda is a leader in AI cloud infrastructure serving tens of thousands of customers. Founded in 2012, the company has 500+ employees and is growing fast.