Forward Deployed Engineer New Grad

The role

You will work directly with customers to build demanding AI applications. You will operate at the intersection of software engineering, infrastructure, product, and customer success.

What you will do

• Own the technical relationship with customers from evaluation through production.
• Understand customer architectures, workloads, and engineering requirements.
• Deploy and integrate Model APIs, inference endpoints, dedicated model serving, and Agent Sandbox environments.
• Debug issues across APIs, containers, Linux, networking, model serving, and distributed systems.
• Analyze inference performance including latency, throughput, concurrency, caching, and reliability.
• Build customer-specific integrations, prototypes, tools, and automation.
• Support PoCs and help customers transition into production.
• Work with Technical Account Executives on capacity planning, quotas, pricing, and workload expansion.
• Identify opportunities where customers can expand their usage of Novita.
• Translate recurring customer problems into product requirements.

Required qualifications

• Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field.
• Strong software engineering fundamentals.
• Proficiency in Python and experience with at least one additional programming language.
• Strong understanding of APIs, Linux, networking, and cloud-native applications.
• Experience debugging complex technical systems.
• Strong written and verbal communication skills.
• Comfortable working directly with customers.
• High ownership and ability to operate in ambiguous environments.
• Ability to move quickly between engineering, product, and customer problems.

Nice to have

• Experience with LLMs, AI agents, or inference infrastructure.
• Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.
• Experience with Docker and Kubernetes.
• Understanding of model serving performance, including batching, caching, throughput, latency, and concurrency.
• Experience building coding agents, AI agents, or sandboxed execution systems.
• Open-source contributions, startup experience, or significant technical side projects.
• Background in solutions engineering, developer relations, technical consulting, or other customer-facing technical roles.
• Interest in the commercial side of technology, including how usage, pricing, and product adoption connect.
• Professional working proficiency in Mandarin Chinese.

About the company

Novita AI is an AI & Agent Cloud platform for builders. They provide high-performance Model APIs, dedicated inference infrastructure, and Agent Sandbox environments.