Member of Technical Staff - AI Training Platform

The role

You will build and scale the end-to-end tooling required to train, evaluate, and benchmark models. You will architect and maintain the core AI/ML/RL training platform and infrastructure.

What you will do

• Architect, scale, and maintain the core AI/ML/RL training platform and infrastructure.
• Design and scale multi-node distributed training systems.
• Implement elastic sharding and robust data streaming pipelines.
• Implement robust model checkpointing and recovery mechanisms.
• Maintain and expand the proprietary training framework.
• Develop and optimize kernels using low-level programming models like CUDA and Triton.
• Design benchmarking suites to track Model Flops Utilization, memory bandwidth, and convergence stability.
• Build and iterate on tooling to enable rapid evaluation of novel hardware ideas.
• Discuss algorithmic trade-offs with theorists and convert model requirements into specifications.
• Design systems to track and visualize quality-vs-efficiency Pareto frontiers.

Required qualifications

• BS in Computer Science, Physics, Electrical Engineering, or Applied Math.
• 5+ years of experience in AI/ML engineering.
• Demonstrated ability to map state-of-the-art AI model architectures to system performance implication.
• Deep expertise in how models are partitioned across a cluster, with a mastery of communication primitives, and parallelism strategies.
• Strong programming skills in Python or C++.
• Proven track record of implementing, debugging, and maintaining production-grade training frameworks such as Megatron-LM, DeepSpeed, Ray, PyTorch Lightning.

Nice to have

• MS/PhD or equivalent research/project experience in AI/ML or high-performance computing, with publications
• Experience in training, post-training large-scale LLMs and generative models.
• Experience in Kubernetes, GPU kernels and performance tuning, LLM inference, CUDA, Triton, NCCL, vLLM, SGLang, VeRL, TRL.

Benefits

• Competitive salary
• Significant equity
• Best-in-class health benefits
• 401k matching
• Truly unlimited PTO
• Complimentary meals when working from our Palo Alto office

About the company

Unconventional is rethinking computing from the ground up to build a new foundation for AI that is 1000x more efficient by exploiting the rich physics of semiconductors.