Quberesearchandtechnologies

Production Support Engineer — LLM Platform

Hong Kong. Posted 2 months ago

The role

This person will provide first- and second-line support for the LLM gateway platform. They will monitor infrastructure, troubleshoot model-serving backends, and build automation to improve operational visibility.

What you will do

  • Provide first- and second-line support for LLM gateway platform
  • Monitor and maintain the platform's underlying infrastructure
  • Support and troubleshoot model-serving backends and provider integrations
  • Triage incidents affecting model availability
  • Support the tooling layer built on top of LLM gateway
  • Coordinate with platform engineering, cloud infrastructure and end-user teams
  • Support release management and change processes
  • Build tooling and automation to improve monitoring and diagnostics
  • Contribute to the design and implementation of monitoring, dashboards and alerting
  • Own and improve operational documentation, runbooks and user-facing status communication

Required qualifications

  • Experience in a production support, SRE or platform operations role within a fast-paced environment
  • Strong Linux and Windows system administration skills
  • Proficiency scripting and automating in Python, Bash and/or PowerShell
  • Solid experience with relational databases such as PostgreSQL or SQL Server
  • Practical understanding of monitoring and observability
  • Comfortable debugging distributed, API-driven services
  • Familiarity with large language model concepts and hosting environments
  • Exposure to public cloud, ideally AWS (Bedrock, networking, IAM, logging/metrics), and to containerised or Kubernetes-based workloads
  • Ability to communicate clearly with both engineers and non-technical users
  • Awareness of data-sensitivity and access-control considerations

Nice to have

  • Experience supporting developer tooling and AI coding assistants (e.g. Claude Code, OpenCode) or IDE/workspace platforms
  • Experience with Grafana, Prometheus or equivalent observability stacks
  • Experience with CI/CD and infrastructure-as-code (Terraform, Ansible, or similar)
  • Experience operating multi-region services and troubleshooting region-specific performance issues
  • Experience acting as the operational interface to third-party vendors and cloud providers during degradations

Benefits

  • Initiatives and programs to enable employees achieve a healthy work-life balance

About the company

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager. It is a technology and data driven group implementing a scientific approach to investing.

Production Support Engineer — LLM Platform at Quberesearchandtechnologies | JobZoey