Engineering Manager, Provider Ecosystem

Remote (US). Posted a month ago

The role

You will lead the Provider Ecosystem team to manage models, endpoints, and providers. You will own provider adapters, the endpoint lifecycle, routing, and expansion into multi-modal capabilities.

What you will do

Hire and grow engineers, set the roadmap, and stay hands-on in code reviews and incidents.
Own provider adapters, the endpoint lifecycle, and routing.
Act as the technical counterpart for top providers.
Run day-zero and stealth launches.
Work with GTM, BD, and legal to onboard providers.
Lead expansion into image, video, audio, embeddings, realtime, and batch inference.
Own evals and inference quality to inform routing decisions.

Required qualifications

4+ years of engineering management experience, including building or scaling a team during rapid growth.
Strong technical foundation in distributed systems, API design, and LLM inference.
Understanding of how inference is served including streaming, tool calling, prompt caching, quantization, throughput and latency trade-offs.
Understanding of how provider APIs differ and routing millions of requests across heterogeneous endpoints.
Hands-on and comfortable writing code and using AI-assisted development tools.
Comfortable being externally facing to negotiate integrations with model labs.
Data-driven about quality using benchmarks, evals, and production telemetry.
Proven ability to recruit and retain strong engineers.
High agency and clear communication.
Pragmatic about what a lean engineering org needs.

Nice to have

Experience at an inference provider, model lab, or GPU cloud, or building products on top of many LLM APIs at once.
Experience with TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel.
Background in evals, benchmarking, or routing and load-balancing systems.
Experience shipping multimodal APIs (image, video, speech, embeddings) or realtime and batch inference.
Experience running vendor security and compliance reviews (NDA, DPA, SOC 2).
Existing user of OpenRouter, or active side projects in AI infrastructure or developer tooling.

About the company

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize large language models across providers.