Firmus

Senior AI Infrastructure Engineer, Kubernetes

San Francisco, California, United States. Posted 2 months ago

The role

This person will own the technical design and delivery of the backend infrastructure for the Firmus Kubernetes platform. They will build production-grade cluster lifecycle, networking, storage, security, and automation capabilities across GPU-accelerated bare-metal environments.

What you will do

  • Define and own the Kubernetes platform reference architecture.
  • Build and maintain backend services, APIs, controllers, operators, and automation.
  • Engineer repeatable bare-metal Kubernetes deployment and lifecycle workflows.
  • Design and operate cluster networking including CNI, ingress, and service mesh.
  • Define persistent-storage and data-service patterns.
  • Integrate and productionise NVIDIA GPU and Network Operators.
  • Establish GitOps and CI/CD patterns for platform software and configuration.
  • Build platform security through identity, access control, and tenant isolation.
  • Define service-level objectives and engineer observability.
  • Set engineering standards and mentor senior engineers.

Required qualifications

  • 7+ years of progressive infrastructure, systems, or platform engineering experience.
  • At least 3 years operating at senior staff, principal, or equivalent level.
  • Deep knowledge of Kubernetes internals.
  • Experience designing, building, and operating highly available, large scale and multi-cluster Kubernetes platforms on bare metal, private cloud, or hybrid infrastructure.
  • Strong software engineering ability in Go and/or Rust, with practical Python and Bash skills.
  • Expert Linux systems knowledge.
  • Strong Kubernetes networking expertise across Cilium, Calico, or equivalent CNI implementations.
  • Strong infrastructure automation and GitOps experience.
  • Practical experience with Kubernetes security and governance.
  • Experience implementing production observability with Prometheus, Grafana, OpenTelemetry, Loki, Elasticsearch, or equivalent technologies.
  • Experience with GPU-enabled Kubernetes infrastructure.
  • Experience with distributed storage and data services.

Nice to have

  • CKA, CKS, or relevant cloud-native certifications

About the company

Firmus Technologies is a global leader pioneering the development and operation of efficient AI infrastructure across Asia Pacific. They design, build, and operate the AI Factory to deliver low-cost AI tokens globally.

Senior AI Infrastructure Engineer, Kubernetes at Firmus | JobZoey