Machine Learning Infra Engineer

The role

You will build and maintain training and inference stacks to deliver results at scale. You will collaborate with ML and Platform teams to scale training across nodes and develop efficient serving.

What you will do

• Build and maintain the training and inference stack.
• Develop benchmarks for both sets of stacks to identify bottlenecks.
• Explore SOTA advances in training and inference and work to apply them.
• Design systems for scaling model training across multi-node, multi-GPU environments.
• Scale distributed training and inference workloads across large GPU clusters.
• Build tooling, abstractions, and observability to help ML engineers move from experiment to production.

Required qualifications

• Strong Python skills
• Background in systems engineering
• Comfortable with Kubernetes and distributed training frameworks
• 3+ years of experience

Nice to have

• Experience at an early-stage or high-growth startup
• Developed in open source training/inference stacks in a meaningful way
• Excited to set up distributed inference across 100s-1000s of GPUs
• Care deeply about combining technical excellence with business impact

Benefits

• Unlimited PTO
• Free lunch daily at the office
• Reimbursed Transportation
• Generous health insurance covering medical, dental, and vision
• Up to $150/mo reimbursement for health and wellness spending
• Parental Leave

About the company

Reducto is the agentic document platform for leading AI teams. They provide a toolkit for working with documents using custom in-house and frontier models.