Senior AI Platform Engineer

The role

You will design, build, and operate parts of the AI enablement stack including GPU inference serving, model gateways, agent harnesses, and observability. You will own platform components end to end and work closely with the Applied AI Research team.

What you will do

• Own 1 or more platform components end to end from design doc to production operation
• Build and operate services in your focus area and contribute across the stack
• Write clean, well-tested code
• Debug hard production issues like tail latency, GPU memory pressure, or agent runs
• Scope and estimate efforts with internal customers and raise risks early
• Review teammates' code and designs
• Help onboard new engineers
• Run focused benchmarks and experiments

Required qualifications

• 4+ years of software engineering experience
• 2+ years building and operating ML/AI or LLM systems in production
• Production-grade Python
• API and service design
• Distributed systems
• Containers and orchestration such as Kubernetes
• CI/CD
• Testing
• Production experience in at least 1 focus area: Model serving, Agentic infrastructure, or Observability and experimentation
• Solid data science and AI research fundamentals
• Working familiarity with PyTorch and Hugging Face
• Experience owning a service or component in production

Nice to have

• Experience in more than 1 focus area
• Production experience running an LLM gateway or proxy such as SMG or Bifrost, or building an API gateway
• Familiarity with inference optimization: speculative decoding, prefix caching, tensor/pipeline/expert parallelism, GPU profiling
• Experience with durable workflows, agent frameworks, or tool protocols such as MCP
• Experience fine-tuning language models, including distributed training across multiple GPU nodes
• Experience with experiment-tracking or artifact management systems such as MLflow or Weights & Biases
• Experience deploying AI systems on-prem or in regulated domains such as defense or aerospace

Benefits

• Health care plan with 100% premium coverage, including medical, dental, and vision
• 401k with 5% matching
• Paid Time Off (uncapped vacation, plus sick and public holidays)
• Flexible hybrid or remote work arrangement
• Relocation assistance for qualifying employees

Before you apply

• US Citizenship may be required for certain project assignments involving security clearance

About the company

Code Metal is the leader in automated software engineering. They use formal methods to provide provably correct code for customers including the U.S. Air Force, L3Harris, RTX, and Toshiba.