Openai
Machine Learning Engineer, Implicit Signals
San Francisco, Remote. Posted a month ago
The role
You will develop new classification and evaluation capabilities and bring them into production. You will build, deploy, and operate systems that provide feedback to post-training and research teams.
What you will do
- Build, deploy, and operate production classification and evaluation systems.
- Optimize production inference including model serving, batching, caching, throughput, latency, compute utilization, and cost.
- Train and optimize classifiers using supervised fine-tuning and distillation.
- Own the reliability and observability of deployed classifiers.
- Design rigorous evaluations to assess accuracy, calibration, generalization, and potential measurement bias.
- Partner with software engineers to integrate models into reliable execution systems.
- Build reusable engineering tools for classifier training, evaluation, deployment, and iteration.
- Work with post-training researchers and data scientists to translate needs into modeling objectives and production requirements.
Required qualifications
- Experience taking ML projects from problem formulation and experimentation through production deployment.
- Strong foundations in supervised learning, statistics, and experimental design.
- Practical experience evaluating models, investigating systematic errors, and working with imperfect labels.
- Strong software engineering skills and the ability to build maintainable production ML systems.
- Experience reasoning about inference performance and the tradeoffs between quality, latency, and compute cost.
- The ability to combine careful scientific judgment with a practical approach to shipping and operating software.
- Comfort working closely with researchers and engineers on open-ended problems.
- Fluency in using AI agents to move quickly across multiple workstreams in a fast-paced environment.
Nice to have
- Experience with model distillation, representation learning, calibration, or efficient inference
About the company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.