Forward Deployed Engineer

The role

You will partner with customers to understand AI workloads and deploy solutions. You will integrate model APIs, GPU infrastructure, and sandbox environments into real-world applications.

What you will do

• Work directly with customers to understand AI products, technical requirements, and business goals.
• Deploy and integrate Model APIs, inference endpoints, dedicated model hosting, GPU cloud infrastructure, and agent sandbox environments.
• Debug production issues across APIs, networking, containers, GPUs, and distributed systems.
• Build customer-specific solutions, integrations, demos, and prototypes.
• Travel to customer sites when necessary and collaborate with engineering teams.
• Translate customer feedback into product requirements.
• Create reusable tooling, automation, and reference implementations.
• Support proof-of-concepts and help customers move into production.

Required qualifications

• Strong software engineering fundamentals.
• Proficiency in Python and at least one additional programming language.
• Experience building or deploying cloud-native applications.
• Familiarity with Docker, Kubernetes, Linux, and networking concepts.
• Strong debugging and problem-solving skills in production environments.
• Excellent communication skills and ability to work directly with customers.
• Ability to operate with ambiguity and move quickly in a startup environment.

Nice to have

• Experience with AI/ML infrastructure, LLMs, or inference systems.
• Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.
• Experience working with GPUs, CUDA, or large-scale compute systems.
• Background in solutions engineering, developer relations, or customer-facing engineering roles.
• Experience building AI agents, coding agents, or sandboxed execution environments.
• Prior startup experience or experience as an early engineer.
• Professional working proficiency in Mandarin Chinese.

Benefits

• Competitive pay package
• 100% employer-covered premium medical, dental, and vision insurance
• 401(k) plan
• free meals in the office

About the company

Novita AI is an AI & Agent Cloud platform for builders. They provide a unified platform for Model APIs, GPU Cloud, and Agent Sandbox infrastructure.