Crusoe
Staff Network Production Engineer, Operations
San Francisco, CA - US. Posted 3 months ago
The role
This role owns production reliability across global network infrastructure including edge, backbone, data center fabric, and GPU cluster interconnects. You will build Python-based automation, manage incident response, and improve observability to support hyperscale AI workloads.
What you will do
- Own uptime across global edge, backbone, data center, and GPU cluster network
- Build and maintain Python-based tooling to reduce toil and automate workflows
- Develop scripts and tooling to speed up detection, triage, and mitigation during network events
- Build tooling to surface systemic issues during RCAs
- Write automation on top of the monitoring stack
- Author and maintain runbooks, escalation playbooks, and SOPs
- Partner with Architecture and SRE teams to define and track network reliability metrics
- Provide technical guidance to Senior engineers
Required qualifications
- 8+ years of production network engineering experience in large-scale or internet-scale environments
- Strong Python and scripting proficiency
- Hands-on experience with streaming telemetry, SNMP, NetFlow/sFlow, Grafana, Prometheus, and ThousandEyes
- Experience operating RDMA/RoCE lossless fabrics for GPU or HPC workloads
- Expert hands-on knowledge of BGP, EVPN-VXLAN, IS-IS, OSPF, MPLS, QoS, and TCP/IP
- Proficiency with Arista (EOS) and Juniper (Junos) platforms
- Comfort operating large device fleets across multi-region environments with on-call responsibility
- Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience
Nice to have
- Experience with NVIDIA/Mellanox networking platforms in GPU cluster environments
- Familiarity with Kentik or Arbor for traffic analysis and DDoS visibility
- Experience defining or contributing to SLIs and SLOs in partnership with SRE or product teams
- Exposure to operating 10K+ device fleets across hyperscale or cloud environments
- Background contributing to post-incident learning programs or operational excellence initiatives org-wide
Benefits
- Competitive compensation and equity packages
- Restricted Stock Units
- Paid time off, paid holidays & leave of absence programs
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account
- Paid parental leave
- Paid life insurance, short-term and long-term disability
- Professional development & tuition reimbursement
- Mental health & wellness support
- Commuter benefits (parking & transit)
- Cell phone stipend
- 401(k) Retirement plan with company match up to 4% of salary
About the company
Crusoe is a vertically integrated AI infrastructure company that owns and operates each layer of the stack to power AI workloads. The company uses an energy-first approach to solve power bottlenecks for AI compute.