Scaleai

Senior/Staff Machine Learning Research Engineer, General Agents, Enterprise GenAI

San Francisco, CA; New York, NY. Posted 9 months ago

The role

You will design, build, and deploy production-ready AI agents for enterprise use cases. You will work across the full agent lifecycle including model design, evaluation, and deployment.

What you will do

  • Design and implement end-to-end agent systems using LLM reasoning, tool use, memory, and control logic.
  • Build scalable, reliable agent architectures for many customers.
  • Develop evaluation frameworks, datasets, environments, and metrics.
  • Collaborate with product managers, customers, data annotators, and engineering teams.
  • Productionize frontier agent techniques like planning and multi-step reasoning.
  • Own deployment, monitoring, and iteration of agent systems.
  • Contribute to technical direction and architectural decisions.

Required qualifications

  • 5+ years of experience building and deploying machine learning or AI systems for real-world, production use cases.
  • Bachelor’s and/or Master’s degree in Computer Science, Machine Learning, AI, or equivalent practical experience.
  • Deep understanding of modern LLMs, prompt-, context-, and system-level optimization, and agentic system design.
  • Proficiency in Python, including writing production-quality, testable, and maintainable code.
  • Experience building systems that integrate models with external tools, APIs, databases, and services.
  • Ability to operate in ambiguous problem spaces.
  • Strong communication skills.

Nice to have

  • Hands-on experience building AI agents using modern generative AI stacks (OpenAI APIs, commercial or open-source LLMs).
  • Experience with agent frameworks, orchestration layers, or workflow systems.
  • Familiarity with evaluation, monitoring, and observability for LLM-powered systems in production.
  • Experience deploying ML systems in cloud environments and operating them at scale.
  • Experience fine-tuning or adapting foundation models using methods like SFT, RLVR, and LoRA.

Benefits

  • Base salary
  • Equity
  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend

Before you apply

  • 90-day waiting period before reconsidering candidates for the same role.

About the company

Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. They partner with leading enterprises and government organizations to accelerate AI initiatives.

Senior/Staff Machine Learning Research Engineer, General Agents, Enterprise GenAI at Scaleai | JobZoey