Openai
Applied AI Software Engineer, GTM Growth Engineering
San Francisco. Posted 3 months ago
The role
You will build production systems to improve AI-powered go-to-market workflows. You will own the agent improvement loop by connecting agent behavior, feedback, evaluation, and business outcomes.
What you will do
- Own the production improvement loop across agent behavior, feedback, evaluation, and experimentation.
- Instrument agent workflows to understand model interactions, tool use, and decisions.
- Define quality standards, evaluation datasets, and production monitoring.
- Investigate why agents underperform across context, knowledge, tools, or routing.
- Design and ship behavior improvements including prompting and decision logic.
- Build backend services, APIs, data models, and feedback pipelines.
- Run controlled experiments, production replays, or staged rollouts.
- Partner with Product, Data Science, Sales, and B2B Marketing to prioritize problems.
- Ship with safeguards for privacy, security, reliability, and human oversight.
Required qualifications
- 4+ years of software, backend, applied AI, or product-engineering experience building reliable production systems.
- Experience building AI agents, LLM-powered applications, or other model-driven workflows that operated on real production traffic.
- Experience diagnosing and improving agent behavior using production traces, user feedback, evaluation, experimentation, or careful systems design.
- Practical experience with evaluation design, regression testing, human or model grading, online quality signals, or controlled experiments.
- Strong backend engineering skills across Python, APIs, data pipelines, stateful workflows, and production services.
- Strong product judgment and the ability to connect technical changes to customer experience, conversion, qualified pipeline, or operational efficiency.
- Comfort working across model behavior, context, knowledge, tools, workflow state, and human-in-the-loop decisions.
- The ability to work closely with technical and non-technical partners across Engineering, Product, Data Science, Sales, and B2B Marketing.
- A pragmatic mindset: you can scope ambiguous problems, ship useful improvements, and build toward a durable system.
Nice to have
- Experience building agent evaluation, observability, experimentation, or AI infrastructure products.
- Experience with production replay, LLM grading, human-labeled datasets, shadow evaluation, or staged rollout.
- Experience improving model or agent behavior through context design, prompting, tools, decision logic, or feedback loops.
- Experience with sales, B2B marketing, revenue, CRM, campaign, or other GTM-facing systems.
- Experience measuring customer engagement, qualified pipeline, conversion, or operational efficiency.
Before you apply
- Background checks for applicants will be administered in accordance with applicable law.
About the company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They seek to safely deploy AI to the world through their products.