Senior/Staff Software Engineer, Infrastructure (ML)

The role

You will build training and inference systems that power general-purpose warehouse robots. You will own training infrastructure end to end to ensure GPU utilization and reproducible runs.

What you will do

• Design, develop, and maintain ML training infrastructure
• Build low-latency inference pipelines for production robotics workloads
• Develop, tune, and optimize low-level CUDA kernels
• Design training-platform systems for scalable model training
• Participate in and lead design reviews
• Review code and provide feedback
• Contribute to documentation and educational materials
• Mentor junior engineers

Required qualifications

• Bachelor’s, Master’s, or PhD in Computer Science or a related field, or equivalent practical experience
• 4+ years of industry experience in infrastructure, distributed systems, ML systems, robotics, or a related area
• Experience with programming languages such as Rust, Go, Python, or C++
• Experience with ML frameworks such as PyTorch or JAX
• Strong understanding of distributed systems, systems programming fundamentals, memory management, and performance optimization
• Experience with Kubernetes orchestration, resource scheduling for large distributed jobs, and containerized deployment pipelines
• Ability to debug and optimize bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operations
• Ability to reason from first principles and optimize systems for both memory-bound and compute-bound workloads
• Strong cross-functional communication skills, ownership, and a growth mindset

Nice to have

• Hands-on experience with distributed training frameworks and techniques such as PyTorch DDP/FSDP, DeepSpeed, Megatron, or NCCL
• Hands-on experience with GPU kernel development
• Experience with data engineering technologies such as Parquet, Arrow, or similar systems

Benefits

• Unlimited Flexible Time Off
• Medical, dental, and vision insurance
• Paid Parental Leave
• Fully-paid parking spots
• Referral Bonus
• 401k
• Equity

About the company

Nimble is an AI robotics company building the autonomous supply chain to power fast, efficient and economical commerce. They are training robot AGI to power a proprietary generalist supply chain superhumanoid.