Openai
Network Operations Engineer, AI Networking
San Francisco. Posted 2 months ago
The role
You will operate and improve large-scale Ethernet fabrics that support GPU clusters, storage systems, and management infrastructure. This role involves production operations, automation, observability, and incident response across a global AI network.
What you will do
- Own the operational health, availability, and reliability of production AI network infrastructure.
- Monitor, troubleshoot, and resolve network incidents.
- Operate and maintain large-scale Ethernet fabrics.
- Execute production network changes, maintenance windows, and capacity expansions.
- Manage the hardware lifecycle including switch and optics replacements.
- Support new AI cluster deployments, data center expansions, and infrastructure migrations.
- Partner with cloud service providers, colocation providers, and hardware vendors.
- Perform root-cause analysis for production incidents.
- Build and maintain monitoring, telemetry, dashboards, and alerting.
- Develop and improve operational runbooks, playbooks, and documentation.
Required qualifications
- Bachelor’s degree in Computer Science, Network Engineering, or a related discipline, or equivalent practical experience.
- 5+ years of experience operating large-scale data center, cloud, AI, or HPC network infrastructure.
- Experience supporting production network environments with high-availability requirements.
- Hands-on experience with one or more of the following platforms: Cisco NX-OS, Arista EOS, NVIDIA Spectrum / Cumulus Linux, or Juniper JunOS.
- Strong knowledge of Layer 2 and Layer 3 networking, BGP, OSPF, ECMP, MLAG, LACP, VRFs, and VLANs.
- Experience troubleshooting physical infrastructure, including fiber optics, transceivers, DAC/AOC cables, and high-speed Ethernet links.
- Experience performing software upgrades, hardware maintenance, and production change management.
- Excellent analytical and troubleshooting skills.
Nice to have
- Experience operating AI or High-Performance Computing (HPC) network environments.
- Experience with NVIDIA AI networking technologies and GPU infrastructure.
- Experience supporting RoCE v2 or RDMA-based Ethernet fabrics, with a strong understanding of Priority Flow Control (PFC), Explicit Congestion Notification (ECN), Data Center Quantized Congestion Notif
- Experience supporting 100G, 200G, 400G, and 800G Ethernet networks.
- Experience with GPU platforms including NVIDIA HGX, DGX, GB200, or equivalent AI infrastructure.
- Experience supporting distributed storage environments such as VAST, DDN, or similar technologies.
- Experience working with cloud service providers such as AWS, Azure, or Google Cloud, and with third-party colocation providers.
- Experience with network monitoring and telemetry technologies, including Prometheus, Grafana, gNMI, streaming telemetry, SNMP, or similar tools.
- Experience developing automation using Python, Git, REST APIs, Terraform, or similar automation frameworks.
Before you apply
- Participate in a 24x7 on-call rotation.
- Background checks for applicants will be administered in accordance with applicable law.
About the company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.