42dot

AI Infrastructure Engineer

Pangyo (Software Dream Center), South Korea, Remote. Posted 3 months ago

The role

The AI Infrastructure Engineer manages high-performance AI infrastructure orchestrating thousands of GPUs across multiple data centers. You will contribute to scaling, monitoring, and operational optimization of the computing environment.

What you will do

  • Operate and maintain a large-scale GPU cluster using Kubernetes and Slurm
  • Monitor and diagnose failures across GPU hardware and software stacks
  • Develop automation tools and scripts using Python or Shell
  • Manage GPU resource quotas
  • Provide technical support to ML researchers
  • Participate in architectural design and performance tuning of distributed training environments

Required qualifications

  • Strong proficiency in Linux operating systems, including kernel operations, process management, and system security
  • Practical experience with containerization technologies (Docker) and orchestration (Kubernetes)
  • Solid understanding of networking fundamentals, including TCP/IP and HTTP(S)
  • Ability to write clean and maintainable scripts in Python or Shell
  • Logical approach to problem-solving in complex, large-scale systems
  • Strong communication skills to collaborate with cross-functional teams and external partners

Nice to have

  • Experience in building observability stacks with Prometheus, Grafana, and Datadog
  • Experience in building or operating infrastructure on public cloud platforms such as AWS or GCP
  • Knowledge of the NVIDIA accelerated computing stack, including drivers, CUDA, and NCCL
  • Familiarity with the ML model training lifecycle and deep learning frameworks such as PyTorch or TensorFlow
  • Experience with large-scale workload managers or resource scheduling tools such as Kubernetes or Slurm
  • Familiarity with Infrastructure as Code (IaC) tools such as Terraform

Before you apply

  • Application Screening
  • Coding Test
  • First Interview (Virtual, approximately 1 hour)
  • Second Interview (In-person or Virtual, approximately 3 hours)
  • A reference check may be conducted after the interview process with your consent

About the company

42dot manages high-performance AI infrastructure orchestrating thousands of GPUs across multiple data centers.