Openrouter

Software Engineer, Trust & Safety

Remote (US). Posted a month ago

The role

You will own the detection, enforcement, and review systems to prevent abuse, fraud, and illegal content. You will build technical systems across signup, payments, and usage, as well as internal tools for investigation and enforcement.

What you will do

  • Build and operate technical systems across signup, payments, and usage to detect abuse and fraud early.
  • Own the technical enforcement pipeline end to end.
  • Build internal tools that support investigation and enforcement decision-making.
  • Ship technical solutions for content safety on the inference path.
  • Build systems, tools, and heuristics for quick detection and scalable enforcement.
  • Investigate incidents directly in the data and build the analytics plane.
  • Build defensible monitoring for risk, abuse spikes, and fraud.
  • Set the technical direction for how to prevent abuse as the platform grows.
  • Work with data scientists on feature exploration and training of risk and abuse ML models.

Required qualifications

  • 4+ years building and operating production systems, ideally including work in trust & safety, fraud, payments risk, security, or anti-abuse.
  • Proficient in React, TypeScript, Next.js, and JS runtimes.
  • Ability to write SQL against large event datasets and reason about base rates, precision and recall, and the cost of a wrong decision.
  • Sound judgment when working with incomplete evidence.
  • High agency and a bias toward action.
  • AI-forward in your workflow, using coding agents often.
  • Comfortable in a small, fast-moving environment where boundaries between teams are intentionally fluid.
  • Discretion and resilience, since parts of this role may involve reviewing or discussing disturbing content and handling sensitive user data.
  • Strong written and verbal communication.
  • Motivated by adversarial problems.

Nice to have

  • Experience with payments fraud tooling (Stripe Radar, chargeback and dispute flows, crypto payment risk), or with identity and KYC systems.
  • Experience with LLM-specific abuse: jailbreaks, prompt injection, key theft and resale, shared or scraped credentials, automated account farming.
  • Experience operating large scale analytical datastores (e.g. ClickHouse, BigQuery) and observability platforms.
  • Familiarity with the reporting and compliance obligations that come with hosted AI, including illegal content reporting and model provider policy requirements.
  • Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling.

About the company

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers. They power advanced AI teams by providing flexibility to move fast and scale confidently.

Software Engineer, Trust & Safety at Openrouter | JobZoey