Forward Deployed Engineer Intern

The role

You will work directly with customers to help them build and launch production AI systems. You will investigate customer problems involving APIs, networking, containers, Linux, and inference workloads.

What you will do

• Work directly with customers building AI products and agents.
• Help integrate Novita Model APIs, dedicated inference endpoints, and Agent Sandbox.
• Reproduce and debug customer issues involving APIs, networking, containers, Linux, and inference workloads.
• Investigate errors, latency, throughput, concurrency, and reliability issues.
• Build demos, integrations, scripts, PoCs, and reference implementations.
• Help customers move from experimentation into production.
• Partner with product, engineering, and SRE teams to resolve customer issues.
• Write documentation, runbooks, and internal tooling.
• Identify patterns across customer workloads and translate them into product improvements.
• Learn how customer usage, technical success, and business growth connect.

Required qualifications

• Currently pursuing a Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
• Strong programming fundamentals.
• Proficiency in Python or another general-purpose programming language.
• Familiarity with Linux and APIs.
• Strong debugging and problem-solving ability.
• Comfortable communicating directly with customers.
• Ability to explain technical concepts clearly.
• High ownership and willingness to work through ambiguous problems.

Nice to have

• Experience building applications using LLM APIs.
• Familiarity with Docker, Kubernetes, or cloud infrastructure.
• Experience with agent frameworks or coding agents.
• Familiarity with vLLM, SGLang, Ray, or other inference systems.
• Understanding of inference concepts such as latency, throughput, caching, batching, and concurrency.
• Hackathon projects, open-source contributions, or startup experience.
• Experience teaching, consulting, developer relations, or supporting technical users.
• Professional working proficiency in Mandarin Chinese.

About the company

Novita AI is an AI & Agent Cloud platform for builders. They provide high-performance Model APIs, dedicated inference infrastructure, and Agent Sandbox environments.