Staff / Senior Staff Machine Learning Engineer, Inference - UK

The role

This person will optimize and serve models for high-volume, realtime workloads. They will take models from research, containerize them, and ensure reliable production serving.

What you will do

• Optimize model serving using modern frameworks.
• Perform model acceleration through quantization, distillation, and caching.
• Manage distributed systems and scaling.
• Take models from research to production.
• Containerize and optimize model serving.
• Ensure models run reliably in production.

Required qualifications

• Proficiency in C++, CUDA, Rust, or highly optimized Python.
• Ability to profile code and optimize performance on NVIDIA GPUs.
• PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.

Nice to have

• Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM.
• Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding.
• Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections.
• Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.

Benefits

• Equity
• Benefits

Before you apply

• Candidates must already have the legal right to work in the United Kingdom.
• Visa sponsorship is not available for this role.

About the company

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. They build first-party speech models, serve LLMs, and run inference for high-volume, realtime workloads.