MTS, Inference Performance Visibility

The role

You will design and develop a performance analysis tool for custom ML accelerator hardware. This includes creating data collection mechanisms, processing pipelines, and visualization tools to identify performance bottlenecks.

What you will do

• Lead the design and architecture of a performance analysis suite.
• Develop methods to capture performance data from custom ML accelerator hardware.
• Implement tracing for host-side API calls and system-level events.
• Design techniques to correlate performance events across host CPU, device driver, PCIe bus, and accelerators.
• Build analysis modules to automatically interpret trace and counter data.
• Develop visualizations to communicate performance characteristics and bottlenecks.
• Work with hardware architects, firmware engineers, driver developers, compiler engineers, and ML application engineers.

Required qualifications

• Strong proficiency in C++ or Rust
• Deep understanding of computer architecture (CPU, GPU, accelerators), memory hierarchies (caches, DRAM), and interconnects (especially PCIe).
• Proven experience in low-level performance analysis, profiling, and bottleneck identification on complex hardware systems (GPUs, CPUs, FPGAs, or custom accelerators).
• Experience with performance analysis tools (e.g., NVIDIA Nsight, AMD uProf, Intel VTune, perf, Tracy, ETW).
• Experience working close to hardware, potentially reading performance counters or interacting directly with device drivers.

Nice to have

• Proficiency in Python is a plus
• Direct experience developing performance analysis or debugging tools.
• Experience with ML accelerator architectures (GPUs, TPUs, etc.).
• Experience with kernel-mode driver development (Linux or Windows).
• Understanding of compiler internals, code generation, and optimization.
• In-depth knowledge of the PCIe protocol and analysis tools (PCIe analyzers).
• Experience with multi-chip or multi-host accelerator systems (e.g., TPU pods, or NVidia DGX clusters)
• Experience with firmware or embedded systems development.
• Experience with hardware description languages (Verilog, VHDL) or hardware verification.

Benefits

• Medical, dental, and vision packages with generous premium coverage
• $500 per month credit for waiving medical benefits
• Housing subsidy of $2.5k per month for those living within walking distance of the office
• Relocation support for those moving to San Jose (Santana Row)
• Various wellness benefits covering fitness, mental health, and more
• Daily lunch + dinner in our office
• Unlimited compute budget subject to ROI justification

About the company

Etched is building hardware for frontier intelligence by co-designing chips, racks, software, and manufacturing. They are a fully in-person team in San Jose (Santana Row).