Openai

Network Operations Engineer, AI Networking

San Francisco. Posted 2 months ago

The role

You will operate and improve large-scale Ethernet fabrics that support GPU clusters, storage systems, and management infrastructure. This role involves production operations, automation, observability, and incident response across a global AI network.

What you will do

  • Own the operational health, availability, and reliability of production AI network infrastructure.
  • Monitor, troubleshoot, and resolve network incidents.
  • Operate and maintain large-scale Ethernet fabrics.
  • Execute production network changes, maintenance windows, and capacity expansions.
  • Manage the hardware lifecycle including switch and optics replacements.
  • Support new AI cluster deployments, data center expansions, and infrastructure migrations.
  • Partner with cloud service providers, colocation providers, and hardware vendors.
  • Perform root-cause analysis for production incidents.
  • Build and maintain monitoring, telemetry, dashboards, and alerting.
  • Develop and improve operational runbooks, playbooks, and documentation.

Required qualifications

  • Bachelor’s degree in Computer Science, Network Engineering, or a related discipline, or equivalent practical experience.
  • 5+ years of experience operating large-scale data center, cloud, AI, or HPC network infrastructure.
  • Experience supporting production network environments with high-availability requirements.
  • Hands-on experience with one or more of the following platforms: Cisco NX-OS, Arista EOS, NVIDIA Spectrum / Cumulus Linux, or Juniper JunOS.
  • Strong knowledge of Layer 2 and Layer 3 networking, BGP, OSPF, ECMP, MLAG, LACP, VRFs, and VLANs.
  • Experience troubleshooting physical infrastructure, including fiber optics, transceivers, DAC/AOC cables, and high-speed Ethernet links.
  • Experience performing software upgrades, hardware maintenance, and production change management.
  • Excellent analytical and troubleshooting skills.

Nice to have

  • Experience operating AI or High-Performance Computing (HPC) network environments.
  • Experience with NVIDIA AI networking technologies and GPU infrastructure.
  • Experience supporting RoCE v2 or RDMA-based Ethernet fabrics, with a strong understanding of Priority Flow Control (PFC), Explicit Congestion Notification (ECN), Data Center Quantized Congestion Notif
  • Experience supporting 100G, 200G, 400G, and 800G Ethernet networks.
  • Experience with GPU platforms including NVIDIA HGX, DGX, GB200, or equivalent AI infrastructure.
  • Experience supporting distributed storage environments such as VAST, DDN, or similar technologies.
  • Experience working with cloud service providers such as AWS, Azure, or Google Cloud, and with third-party colocation providers.
  • Experience with network monitoring and telemetry technologies, including Prometheus, Grafana, gNMI, streaming telemetry, SNMP, or similar tools.
  • Experience developing automation using Python, Git, REST APIs, Terraform, or similar automation frameworks.

Before you apply

  • Participate in a 24x7 on-call rotation.
  • Background checks for applicants will be administered in accordance with applicable law.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

Network Operations Engineer, AI Networking at Openai | JobZoey