Nace.Ai
Research Engineer
Palo Alto, CA. Posted 8 months ago
The role
You will advance core methods behind Small Language Models and a metamodel framework. You will design novel approaches to LLM adaptation, meta-learning, and hypernetworks and carry them from experimentation into production systems.
What you will do
- Advance core methods behind Small Language Models and metamodel framework
- Design novel approaches to LLM adaptation, meta-learning, and hypernetworks
- Carry research from experimentation into systems that power Nace Data Intelligence and the Nace SLM Cloud
- Frame research questions
- Run rigorous experiments
- Publish or open-source where it makes sense
- Partner closely with engineering to ship what works
Required qualifications
- 3+ years of combined research and engineering experience in machine learning, including hands-on work with language models
- Direct experience working with Large Language Models (LLMs) or Vision-Language Models (VLMs) in research or production settings
- Strong research background in Natural Language Processing, Machine Learning, or related disciplines with focus on language modeling
- Proven track record in solving complex problems in language understanding, generation, or multimodal AI using rigorous quantitative methodologies
- Demonstrated ability to clearly communicate research findings to diverse technical audiences
- Proficient programming skills in Python and deep learning frameworks (PyTorch, JAX, or TensorFlow)
- Experience in distributed training and model optimization
Nice to have
- 5+ years of experience conducting applied ML research, with a sustained record of taking novel methods from experimentation to working systems
- PhD in Computer Science, Computational Linguistics, or closely related field with focus on language models and adaptive learning systems
- Proven research and engineering experience with LLMs/VLMs, particularly in meta-learning or parameter-efficient adaptation, as evidenced by grants, fellowships, patents, internships, or contributions
- First authored publications on language models, meta-learning, hypernetworks, or adaptive AI in recognized peer-reviewed conferences (ACL, EMNLP, NeurIPS, ICML, ICLR) or journals
- Kaggle experience
- Research expertise in LLM reasoning, hypernetworks, multi-task learning, meta-learning, designing novel LLM adaptation methods, Online Continual Learning
About the company
Nace AI is an applied research and product company that delivers Sovereign Specialized Intelligence. They equip enterprises with a comprehensive AI stack to build customized, secure intelligence.