AI Software Intern (Canada)

The role

This intern will work on various teams including Kernels, Models, Inference Server, Runtime, Scale Out, or Compiler and Infra. You will develop high performance kernels, optimize ML models, or build software engines and tools for Tenstorrent hardware.

What you will do

• Develop high performance kernels on Tenstorrent hardware
• Optimize ML models for hardware
• Development and serving-side optimization for Inference Server
• Build the software engine that manages memory, task scheduling, and code execution
• Communication and coordination between devices in a distributed AI system
• Create tools that optimize AI models into high-performance programs

Required qualifications

• Currently pursuing a BS, MS, or PhD in Comp Sci, Comp Eng, Physics/Math or a related field
• Coursework or projects in parallel processing, machine learning or distributed systems
• A high comfort level as an end user of AI and agentic flows
• Experience with model quantization, kernel fusion, or other optimization techniques; or low level high performance programming
• Hands on experience working with Pytorch, experimenting with and deploying models, for inference or training
• Experience with C/C++ or kernel development in languages like CUDA, or Python and at least one ML framework (PyTorch, TensorFlow, JAX)

Nice to have

• Knowledge of RTL, HDL

Benefits

• Highly competitive compensation package and benefits

Before you apply

• Offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology
• Offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency

About the company

Tenstorrent is leading the industry on cutting-edge AI technology. Their team has developed a high performance RISC-V CPU from scratch.