Thermo ML Resident

The role

Residents will help pioneer the science of training models in the thermodynamic paradigm. They will collaborate with senior researchers to derive the theory of new probabilistic models and their learning rules.

What you will do

• Collaborate with senior researchers to derive the theory of new probabilistic models and their learning rules, including energy-based models and diffusion models
• Scale up experimentation infrastructure and optimize over the design space of models
• Implement, visualize, and evaluate new architectures, training algorithms, and benchmarks
• Publish papers, contribute to open source, and communicate design insights to our hardware team

Required qualifications

• Experience in scientific Python with JAX or similar deep learning framework (PyTorch, TensorFlow, or Keras)
• Strong foundations in probability and linear algebra
• Projects or papers demonstrating hands-on experience in applied machine learning and data science

Nice to have

• Familiarity with deep learning theory and literature, including theory of over-parameterization and scaling laws
• Experience training energy-based models (EBMs) or diffusion models
• Experience with graph neural networks (GNNs) or graph message passing algorithms
• Experience with infrastructure for deep learning experimentation and training (Slurm, Ray, Kubernetes, Weights & Biases, etc.)
• Strong theoretical background in information geometry
• Strong grasp of computational Bayesian methods, including MCMC sampling methods and variational inference
• Publications in top ML conferences (NeurIPS, ICML, ICLR, CVPR, etc.)

Before you apply

• This position will require access to information subject to control under U.S. export control laws and regulations, including the Export Administration Regulations (EAR)
• Any offer of employment will be conditioned on authorization to receive controlled items

About the company

Extropic is looking for junior ML scientists to join our residency program. Our hardware massively accelerates certain kinds of probabilistic inference.