Datologyai
Research Scientist, Post-Training
San Mateo HQ, Remote. Posted a month ago
The role
You will lead work on post-training data curation for foundation models. You will design and implement algorithms to generate and improve instruction, preference, and other post-training datasets.
What you will do
- Conduct research on how to algorithmically curate post-training data
- Pursue research on end-to-end data curation to unify pre-training and post-training
- Source, vet, implement, and improve ideas from research literature
- Conduct science driven by concrete customer needs and product improvements
- Collaborate closely with engineers and talk to customers
- Shape the product vision
Required qualifications
- 3+ years of deep learning research experience
- Experience with post-training large vision, language, and multimodal models
- Post-training algorithm development, data curation, and/or synthetic data methods for preference-based tuning (e.g. DPO, RLVR, RRHF)
- Alternative supervision & self-supervision techniques such as self-training and chain-of-thought distillation
- SFT (e.g. instruction tuning and demonstration fine-tuning)
- Post-training tooling development and engineering experience
- Strong understanding of the fundamentals of deep learning
- Sufficient software engineering + deep learning framework (PyTorch or a willingness to learn PyTorch) skills
- Demonstrated track record of success in deep learning research, whether papers, tools, or other research artifacts
Nice to have
- Experience with data management and distributed data processing solutions (e.g. Spark, Snowflake, etc.)
- Experience building + shipping ML products
Benefits
- 100% covered health benefits (medical, vision, and dental)
- 401(k) plan with a generous 4% company match
- Unlimited PTO policy
- Paid Parental Leave of 12 weeks, plus 6 months of WFH flexibility
- Annual $2,000 wellness stipend
- Annual $1,000 learning and development stipend
- Daily lunches and snacks are provided in our office
- Relocation assistance for employees moving to the Bay Area
About the company
DatologyAI has built a state of the art data curation suite to automatically curate and optimize petabytes of data. The company has raised $57.5M in Seed and Series A rounds.