Senior Production Engineer, Managed AI

The role

This person will design and operate reliable managed AI services focusing on serving and scaling LLM workloads. They will build automation and reliability tooling to support distributed AI pipelines and inference services.

What you will do

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
• Build automation and reliability tooling to support distributed AI pipelines and inference services
• Define, measure, and improve SLIs/SLOs across AI workloads
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling
• Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments

Required qualifications

• Strong software engineering background
• Experience building production-grade systems beyond scripting or Bash
• Demonstrated experience in distributed systems design and implementation
• Hands-on work with large language models (LLMs) or AI/ML infrastructure
• SRE mindset and experience including defining and measuring SLIs/SLOs
• Building monitoring and observability systems
• Driving performance and reliability improvements
• Designing fault-tolerant systems and automated testing strategies
• Proficiency in at least one modern programming language (Python, Go, Java, C++)
• Familiarity with Kubernetes or container orchestration platforms
• Strong collaboration and communication skills
• Ability to thrive in a fast-paced, mission-driven environment

Nice to have

• Experience scaling inference or training workloads for LLMs

Benefits

• Industry competitive pay
• Restricted Stock Units
• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
• Employer contributions to HSA accounts
• Paid Parental Leave
• Paid life insurance, short-term and long-term disability
• Teladoc
• 401(k) with a 100% match up to 4% of salary
• Generous paid time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the Calm app

About the company

Crusoe is a vertically integrated AI infrastructure company that owns and operates each layer of the stack to power AI workloads. They use an energy-first approach to make AI infrastructure better for the world and faster for innovators.