Applied
AI Performance Engineer
Sunnyvale. Posted 3 months ago
The role
This role focuses on making large-scale machine learning workloads fast and cost-efficient in the datacenter. You will optimize distributed training runs and high-throughput batch inference for autonomy logs.
What you will do
- Profile and optimize distributed training end to end
- Optimize large-scale offline and batch inference over petabyte-scale sensor logs
- Establish roofline and performance models for workloads
- Improve multi-node scaling efficiency
- Drive cluster goodput by reducing GPU idle time
- Build benchmarking, observability, and regression-detection tooling
- Collaborate with engineers across functions to solve complex data and compute problems
Required qualifications
- Bachelor's degree or higher in computer science or adjacent fields
- 1 or more years of hands-on experience with ML performance engineering
- 5 or more years of overall experience
- Experience with distributed multi-node training at scale (FSDP, DeepSpeed, Megatron, NCCL, or equivalent)
- Deep familiarity with GPU or accelerator performance concepts
- Experience with high-throughput or batch inference systems (NVIDIA Triton Inference Server, TensorRT, ONNX Runtime, Ray, or similar)
- Fluency in Python
- Proficiency in C++ or another systems language
- Excellent debugging, analytical, and problem-solving skills
- A deep understanding of machine learning foundations
Nice to have
- GPU kernel development experience: CUDA, Triton, CUTLASS, or hand-tuned attention implementations
- Experience with profiling toolchains such as Nsight Systems/Compute, PyTorch Profiler, or perf
- Experience with GPU scheduling and orchestration on Kubernetes, Slurm, or Ray
- Experience with fault tolerance and elastic training for long-running jobs
- Familiarity with autonomy or robotics data (ROS, OpenCV, multi-sensor log formats)
About the company
Applied Intuition, Inc. is a Silicon Valley company creating digital infrastructure for physical AI. It services the automotive, defense, trucking, construction, mining and agriculture industries.