Openai

Machine Learning Engineer, Implicit Signals

San Francisco, Remote. Posted a month ago

The role

You will develop new classification and evaluation capabilities and bring them into production. You will build, deploy, and operate systems that provide feedback to post-training and research teams.

What you will do

  • Build, deploy, and operate production classification and evaluation systems.
  • Optimize production inference including model serving, batching, caching, throughput, latency, compute utilization, and cost.
  • Train and optimize classifiers using supervised fine-tuning and distillation.
  • Own the reliability and observability of deployed classifiers.
  • Design rigorous evaluations to assess accuracy, calibration, generalization, and potential measurement bias.
  • Partner with software engineers to integrate models into reliable execution systems.
  • Build reusable engineering tools for classifier training, evaluation, deployment, and iteration.
  • Work with post-training researchers and data scientists to translate needs into modeling objectives and production requirements.

Required qualifications

  • Experience taking ML projects from problem formulation and experimentation through production deployment.
  • Strong foundations in supervised learning, statistics, and experimental design.
  • Practical experience evaluating models, investigating systematic errors, and working with imperfect labels.
  • Strong software engineering skills and the ability to build maintainable production ML systems.
  • Experience reasoning about inference performance and the tradeoffs between quality, latency, and compute cost.
  • The ability to combine careful scientific judgment with a practical approach to shipping and operating software.
  • Comfort working closely with researchers and engineers on open-ended problems.
  • Fluency in using AI agents to move quickly across multiple workstreams in a fast-paced environment.

Nice to have

  • Experience with model distillation, representation learning, calibration, or efficient inference

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

Machine Learning Engineer, Implicit Signals at Openai | JobZoey