Openai

Applied AI Software Engineer, GTM Growth Engineering

San Francisco. Posted 3 months ago

The role

You will build production systems to improve AI-powered go-to-market workflows. You will own the agent improvement loop by connecting agent behavior, feedback, evaluation, and business outcomes.

What you will do

  • Own the production improvement loop across agent behavior, feedback, evaluation, and experimentation.
  • Instrument agent workflows to understand model interactions, tool use, and decisions.
  • Define quality standards, evaluation datasets, and production monitoring.
  • Investigate why agents underperform across context, knowledge, tools, or routing.
  • Design and ship behavior improvements including prompting and decision logic.
  • Build backend services, APIs, data models, and feedback pipelines.
  • Run controlled experiments, production replays, or staged rollouts.
  • Partner with Product, Data Science, Sales, and B2B Marketing to prioritize problems.
  • Ship with safeguards for privacy, security, reliability, and human oversight.

Required qualifications

  • 4+ years of software, backend, applied AI, or product-engineering experience building reliable production systems.
  • Experience building AI agents, LLM-powered applications, or other model-driven workflows that operated on real production traffic.
  • Experience diagnosing and improving agent behavior using production traces, user feedback, evaluation, experimentation, or careful systems design.
  • Practical experience with evaluation design, regression testing, human or model grading, online quality signals, or controlled experiments.
  • Strong backend engineering skills across Python, APIs, data pipelines, stateful workflows, and production services.
  • Strong product judgment and the ability to connect technical changes to customer experience, conversion, qualified pipeline, or operational efficiency.
  • Comfort working across model behavior, context, knowledge, tools, workflow state, and human-in-the-loop decisions.
  • The ability to work closely with technical and non-technical partners across Engineering, Product, Data Science, Sales, and B2B Marketing.
  • A pragmatic mindset: you can scope ambiguous problems, ship useful improvements, and build toward a durable system.

Nice to have

  • Experience building agent evaluation, observability, experimentation, or AI infrastructure products.
  • Experience with production replay, LLM grading, human-labeled datasets, shadow evaluation, or staged rollout.
  • Experience improving model or agent behavior through context design, prompting, tools, decision logic, or feedback loops.
  • Experience with sales, B2B marketing, revenue, CRM, campaign, or other GTM-facing systems.
  • Experience measuring customer engagement, qualified pipeline, conversion, or operational efficiency.

Before you apply

  • Background checks for applicants will be administered in accordance with applicable law.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They seek to safely deploy AI to the world through their products.

Applied AI Software Engineer, GTM Growth Engineering at Openai | JobZoey