Snowflake
Intermediate/ Senior Software Engineer - Cortex LLM Training Platform
US-WA-Bellevue, Remote. Posted a month ago
The role
You will design and build across the full stack for the Cortex LLM post-training platform. This includes scaling distributed systems, driving end-to-end performance, and productionizing research building blocks.
What you will do
- Design and build across the full stack from public training APIs and SDK through the control plane to the GPU data plane.
- Scale distributed systems for multi-tenant scheduling, placement, and capacity-aware routing across regional GPU pools.
- Drive end-to-end performance at scale for training, inference, and RL loops.
- Partner with Snowflake Research to turn training and inference techniques into reliable components.
Required qualifications
- 3 + years (Intermediate) or 6+ years (Senior) building and shipping production ML systems
- Strong distributed systems and infrastructure foundation
- Designing scalable, fault-tolerant services and operating them on Kubernetes in production
- Familiarity with GPU and LLM infrastructure e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM
- Ability to debug across the data, infrastructure, and GPU layers
- Demonstrated ability to harden complex systems for reliability, throughput, and cost efficiency
- BS in Computer Science or a related field
Nice to have
- MS/PhD
- Hands-on LLM post-training / modeling experience
About the company
Snowflake is powering the era of the agentic enterprise. The Snowflake ML Platform team's mission is to let customers run their most demanding ML/AI workloads inside Snowflake.