Member of Technical Staff - ML Performance

The role

This person will make ML systems performant at scale. You will contribute to open-source projects and Modal's container runtime to push language and diffusion models toward higher throughput and lower latency.

What you will do

• Make ML systems performant at scale
• Contribute to open-source projects
• Contribute to Modal's container runtime to push language and diffusion models toward higher throughput and lower latency

Required qualifications

• 5+ years of experience writing high-quality, high-performance code
• Worked with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT)
• Familiar with NVIDIA GPU architecture and CUDA
• Experience with ML performance engineering

Nice to have

• Familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc.)

About the company

Modal is building a new infrastructure layer for AI. Customers include Ramp, Cognition, DoorDash, and Suno.