Infrastructure Engineer - Labs

San Jose. Posted 2 days ago

The role

You will own and support racks and server infrastructure across Etched's labs and data center sites, from handoff by forward-deployed engineers through bring-up, validation, and testing. You will build provisioning, networking, storage, and observability so new hardware is ready when it arrives.

What you will do

Own racks and server infrastructure across labs and data center sites, from handoff through bring-up, validation, and testing.
Build full-stack infrastructure for new lab and data center sites: compute, networking, storage, and core services such as DHCP, DNS, zero-touch provisioning, and NFS.
Build and maintain bare-metal provisioning using PXE/iPXE, DHCP, BMC/Redfish imaging, and golden images.
Troubleshoot Linux hosts on custom and early-stage hardware, including kernel, PCIe, NIC, storage, boot, and power issues.
Bring racks onto the network: top-of-rack and uplink configuration, VLAN and IP planning, optics and cabling.
Diagnose physical-layer and hardware faults and coordinate repairs and RMAs with lab staff and vendors.
Help manage the Slurm cluster used to reserve accelerator systems.
Extend Prometheus, VictoriaMetrics, and Grafana observability to every lab rack.
Write infrastructure automation in Ansible and Python through reviewed pull requests.
Manage software releases and changes on lab systems under change control, respond to incidents, and keep runbooks and inventory current.

Required qualifications

4+ years of hands-on infrastructure, data center systems, or bare-metal operations experience in on-prem environments where you physically touched the hardware.
Comfortable across servers, power circuits and PDUs, Linux, networking, and hardware.
Strong Linux systems skills on bare metal, including kernel and driver debugging, PCIe and NIC troubleshooting, storage, and boot issues.
Experience provisioning bare-metal fleets with PXE/iPXE, DHCP, and DNS, and using BMCs (Redfish or IPMI).
Experience writing infrastructure automation in Ansible (YAML, Jinja2) and Python, and working in Git with pull requests, code review, and tests.
Working networking knowledge: L2/L3 fundamentals, VLANs, LACP, switch configuration, and optics and copper cabling at 100G and above.
Experience building or operating observability stacks such as Prometheus, Grafana, or VictoriaMetrics.
Experience with incident response and rolling software and firmware updates across a fleet.
Physically hands-on: able to rack and unrack heavy servers with a lift and run cabling.
Excited about hardware, including early, experimental hardware.
Able to work well with electrical, mechanical, facilities, and software engineers, and document work clearly.
Able to work on-site in San Jose and travel to Bay Area lab and data center sites.

Nice to have

Experience operating GPU, accelerator, or HPC clusters, especially liquid-cooled ones.
Experience with OCP hardware, including Open Rack v3, DC bus bar power, and OpenBMC.
Experience in hardware bring-up and NPI environments (EVT, DVT, PVT).
High-performance networking experience: RoCE/RDMA, Tomahawk-class switches, Arista EOS or SONiC, and 400G cabling.
Slurm and Kubernetes cluster operations experience.
Storage engineering with NVMe, mdadm RAID, and NFS, including benchmarking.
Asset management or DCIM systems experience.
Colocation build-out experience: cross-connects, carrier circuits, and remote-hands coordination.
Identity and access for infrastructure, such as FreeIPA, RADIUS, or TACACS+.
Terraform experience, and running RHEL and Ubuntu side by side.

Benefits

Medical, dental, and vision packages with generous premium coverage
$500 per month credit for waiving medical benefits
Housing subsidy of $2.5k per month for those living within walking distance of the office
Relocation support for those moving to San Jose (Santana Row)
Wellness benefits covering fitness, mental health, and more
Daily lunch and dinner in the office
Unlimited compute budget subject to ROI justification

Before you apply

Relocation support is offered for those moving to San Jose.

About the company

Etched builds hardware for frontier intelligence, co-designing chips, racks, software, and manufacturing with a focus on inference. It is backed by hundreds of millions from top-tier investors.