Research Engineer, Model Inference & Serving - Paris

The role

This person will build and operate the inference stack that serves multimodal agentic models. They will improve latency, throughput, and cost of model serving while researching and implementing inference techniques.

What you will do

• Build and operate the inference stack that serves H's multimodal agentic models
• Improve latency, throughput, and cost of model serving across the stack
• Research and implement inference techniques tailored to agent workloads
• Co-design with the Models team on training-time decisions that affect inference
• Collaborate with cross-functional teams to integrate inference into agentic AI products
• Evaluate inference, serving, and hardware platforms, and communicate findings to stakeholders
• Stay current with advancements in inference, model serving, and accelerator technology

Required qualifications

• Strong software engineering track record
• Proficient in Python and at least one systems language (Rust, C++, or Go)
• Hands-on experience with deep learning frameworks (PyTorch, JAX)
• Solid distributed systems fundamentals
• Experience working in a modern cloud environment and with production ML infrastructure (Kubernetes, etc.)
• Working knowledge of modern ML, including transformers and multimodal architectures
• An advanced degree with research output, or publications at top-tier AI or systems venues (e.g., NeurIPS, ICML, MLSys, OSDI), research internships, or substantive open-source contributions
• Excellent communication and presentation skills
• Strong collaboration and teamwork skills
• Passion for inference and AI

Nice to have

• Startup experience
• Hands-on experience with inference frameworks (vLLM, SGLang, TensorRT-LLM)
• Writing or modifying GPU kernels (CUDA, Triton, etc.)
• Edge or on-device inference experience (llama.cpp, MLX, ONNX Runtime, etc.)
• Experience with quantization, speculative decoding, disaggregated inference or KV-cache compression
• Experience with multimodal models and/or agentic systems

Benefits

• Join the exciting journey of shaping the future of AI
• Collaborate with a fun, dynamic and multicultural team, working alongside world-class AI talent in a highly collaborative environment
• Competitive salary
• Opportunities for professional growth, continuous learning, and career development

About the company

H exists to push the boundaries of superintelligence with agentic AI. The company seeks to automate complex, multi-step tasks typically performed by humans.