Research Intern, Inference (Summer 2027)

The role

You will design and conduct experiments to validate hypotheses. You will work on co-designing and implementing cross-layer optimizations across models, systems, and hardware.

What you will do

• Design and conduct rigorous experiments to validate hypotheses
• Communicate the plans, progress, and results of projects to the broader team
• Document findings in scientific publications and blog posts

Required qualifications

• Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
• Strong knowledge of Machine Learning and Deep Learning fundamentals
• Experience with deep learning frameworks (PyTorch, JAX, etc.)
• Strong programming skills in Python
• Familiarity with Transformer architectures and recent developments in foundation models

Nice to have

• Prior research experience in foundation models , efficient machine learning , or ML systems .
• Publications at leading conferences in machine learning or systems (i.e., MLSys, ICLR )
• Experience with CUDA programming (for kernel development)
• Understanding of model optimization techniques and hardware acceleration approaches
• Contributions to open-source machine learning projects

Benefits

• Competitive compensation
• Housing stipends
• Other competitive benefits

Before you apply

• Candidates are limited to 6 applications within a 90-day period

About the company

Together AI, the AI Native Cloud, is purpose-built for AI engineers. It provides high-performance inference, fine-tuning, reinforcement learning, and pre-training at massive scale.