Software Engineer, TPU Compilers

The role

You will lead the optimization of frontier models on TPUs. This involves owning performance across the full forward pass from model code through kernels to hardware execution.

What you will do

• Optimize model execution on TPUs
• Profile workloads and identify bottlenecks
• Implement improvements to latency, throughput, and hardware utilization
• Develop and optimize kernels
• Explore techniques such as quantization to improve inference efficiency
• Build benchmarks and tools to measure performance and validate correctness
• Partner with researchers and engineers to support new model architectures

Required qualifications

• Practical experience optimizing machine learning workloads on TPUs through training, inference, or both
• Understand modern model architectures and how their computation maps onto accelerator hardware
• Ability to connect detailed kernel behavior to the performance of a complete model
• Strong software engineering skills
• Systematic approach to profiling, debugging, and validating performance improvements
• Ability to take ownership of open-ended technical problems

Nice to have

• Experience with quantization or attention kernels

Before you apply

• Background checks for applicants will be administered in accordance with applicable law

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.