Member of Technical Staff, Machine Learning Platform

The role

You will build and optimize core inference infrastructure for machine learning models. You will work with Infrastructure and Research teams to deploy, optimize, and orchestrate AI models.

What you will do

• Design, deploy and maintain scalable Kubernetes clusters for AI model inference and training
• Develop, optimize, and maintain ML model serving infrastructure
• Collaborate with ML and product teams to scale backend infrastructure
• Optimize compute-heavy workflows and enhance GPU utilization for ML workloads
• Build a robust model API orchestration system
• Collaborate with leadership to define and implement strategies for scaling infrastructure

Required qualifications

• 5+ years of experience in building and deploying machine learning models in production environments
• Deep understanding of container orchestration and distributed systems architecture
• Expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management
• Experience developing APIs and managing distributed systems for both batch and real-time workloads
• Excellent communication skills

Nice to have

• Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
• Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
• Familiarity with GPU cluster management and CUDA optimization
• Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
• Experience with container registries, image optimization, and multi-stage builds for ML workloads
• Experience orchestrating across ASR models or LLM models for building various GenAI applications

Benefits

• 14 paid holidays
• flexible PTO for salaried employees
• accrued time off for hourly employees
• Medical, Dental, and Vision coverage for all full-time employees and their families
• Monthly HSA contributions if choosing a High Deductible Health Plan
• Paid parental leave for all full-time employees
• Family Forming Benefits
• 401(k) Matching
• Personal Device Allowance
• Access to Flexible Spending Accounts (FSA) and Commuter Benefits
• Monthly contributions for fitness, professional development, coworking, and more
• Dedicated access to therapy and coaching

About the company

Abridge is an AI-native clinician intelligence platform designed to help health systems coordinate clinical, financial, and evidence-based decisions. The company has offices in San Francisco, New York, and Pittsburgh.