Backend Engineer, AI Systems

The role

Build and maintain backend services and APIs for AI-powered applications. Develop inference orchestration systems that connect LLMs, application services and external tools.

What you will do

• Build and maintain backend services and APIs for AI-powered applications
• Develop inference orchestration systems that connect LLMs, application services and external tools
• Design APIs for streaming responses, asynchronous processing and real-time interactions
• Improve system performance through caching, batching, concurrency and database optimisation
• Implement monitoring, logging, alerting and error handling for production services
• Diagnose and resolve production issues involving latency, service failures and high traffic
• Work with ML, frontend and mobile engineers on API design, system integration and deployment

Required qualifications

• 3+ years of backend software engineering experience building production systems
• Strong programming skills in Python, Node.js or similar backend technologies
• Experience designing and maintaining REST or gRPC APIs, databases and distributed services
• Understanding of asynchronous processing, concurrency, caching and message queues
• Experience building scalable services and optimising latency, throughput and resource usage
• Experience with SQL or NoSQL databases, Docker and cloud infrastructure
• Ability to debug production issues using logs, metrics and distributed tracing

Nice to have

• Experience integrating LLM APIs, inference services or AI-powered applications
• Experience with model serving, streaming inference or orchestration frameworks
• Experience with Kubernetes and container orchestration
• Familiarity with PyTorch, vLLM or open-source model deployment
• Experience building real-time communication, messaging or high-traffic

About the company

Actai aims to build proactive applications for anyone in the world with minimal to no prompting. Their first application is an agent-first mobile communication app.