Senior Software Engineer – AI Infrastructure

The role

This person will design and build the infrastructure layer powering AI agent systems in production. They will develop high-performance services for model inference, orchestration, and execution.

What you will do

• Design and build the infrastructure layer powering AI agent systems in production
• Develop high-performance services that handle model inference, orchestration, and execution
• Architect scalable systems capable of supporting millions of users and high request throughput
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
• Define guardrails, observability, and failure handling for agent-driven workflows
• Optimize latency, throughput, and cost across inference and orchestration layers
• Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems
• Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

Required qualifications

• 5+ years of experience building and operating high-scale production systems
• Strong Python skills
• Ability to reason about systems performance and reliability
• Deep understanding of distributed systems, reliability engineering, and performance optimization
• Experience operating services serving millions of users or high-throughput workloads
• Familiarity with ML infrastructure, model serving, or MLOps in production environments
• Experience designing observability, monitoring, and failure recovery systems
• Strong collaboration skills working across infrastructure and applied engineering teams
• High ownership mindset in high-stakes production environment

Nice to have

• Experience with Rust
• Experience building infrastructure for agent-based or LLM-powered systems
• Background in high-performance networking, async systems, or low-latency architectures
• Experience with container orchestration and cloud-native infrastructure
• Familiarity with evaluation frameworks and model performance monitoring at scale
• Experience working in fast-moving 0→1 or platform-building teams

Before you apply

• We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process

About the company

Payward is the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks. Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions.