Senior Software Engineer, Backend (Product)

The role

You will own the end-to-end delivery of AI product features and design systems that orchestrate LLMs, retrieval, and structured data. You will work across the full lifecycle of AI-driven features to ensure outputs are reliable and performant.

What you will do

• Own end-to-end delivery of AI product features
• Lead the design and implementation of complex features from concept through production
• Architect systems that orchestrate LLMs, retrieval, and structured data
• Establish and improve feedback loops to improve AI output quality
• Break down ambiguous problems and guide execution across multiple engineers
• Provide guidance on code quality, system design, and product thinking
• Mentor less experienced engineers
• Model effective use of modern AI tools to improve team productivity

Required qualifications

• 5+ years of experience building and scaling product-facing systems
• Track record of owning complex features or product areas end-to-end
• Writes clean, maintainable code
• Makes strong architecture and design decisions across a modern web stack
• Brings a high bar for product quality
• Has experience working with AI/LLM-powered systems, or can ramp quickly
• Drives projects from idea to production with strong ownership
• Thrives in ambiguous, fast-moving environments

Nice to have

• Experience building or experimenting with LLM-powered features (prompting, evaluation, RAG, etc.)
• Experience designing systems that balance latency, cost, and quality
• Exposure to user feedback loops, experimentation, or evaluation frameworks
• Python preferred

About the company

Otter.ai is in the business of shaping the future of work with a mission to make conversations more valuable. It is a leading tool for meeting transcription, summarization, and collaboration.