Klue

Senior Software Engineer, AI

Toronto, Ontario. Posted 2 months ago

The role

You will build and optimize LLM-powered agents that reason, plan, and automate workflows. You will lead the design of search and retrieval agent systems to generate competitive insights.

What you will do

  • Build and ship backend systems that power agentic workflows.
  • Develop and operate evaluation frameworks for agentic systems.
  • Design and optimize retrieval and ranking systems.
  • Improve LLM-powered workflows end to end.
  • Connect technical decisions to customer outcomes.
  • Collaborate across product, infrastructure, and data teams.
  • Evaluate and integrate advances in LLMs and retrieval architectures.

Required qualifications

  • Experience building and operating backend systems in production.
  • Experience in at least one of: search/retrieval, data pipelines, distributed systems, or API-heavy service architectures.
  • Hands-on experience with search, retrieval, or ranking systems.
  • Experience building or evaluating agentic / LLM-powered systems.
  • Strong software engineering fundamentals.
  • Proficiency with Python.
  • Experience with backend frameworks, APIs, and production infrastructure.
  • Familiarity with vector databases and search infrastructure.
  • Experience with cloud infrastructure (AWS, GCP, or Azure).
  • Experience building systems that handle scale, large data volumes, low-latency requirements, and high availability.
  • Use of AI coding tools in development workflow.
  • Ability to lead projects and provide technical direction.

Nice to have

  • Experience designing multi-agent systems or complex orchestration workflows.
  • Background in conversational search or dialogue systems.
  • Contributions to open-source projects in search, retrieval, or the LLM ecosystem.
  • Interest in sharing learnings externally

Benefits

  • Extended health & dental coverage that starts on Day 1.
  • Discounts at Goodlife and Perkopolis.
  • Opportunity to participate in Employee Stock Option Plan.
  • Take the time you need vacation policy.
  • Mac or PC and access to A+ tooling.
  • Direct access to leadership team.
  • Annual company-wide kickoff in Vancouver.
  • Regular social events in Hubs.
  • Dog-friendly spaces in Vancouver and Toronto.

Before you apply

  • Candidates are limited to one engineering application every 60 days.

About the company

Klue helps organizations stop losing winnable deals by generating market, competitor, and buyer insights in a unified platform. The company is AI-first and builds autonomous agents to handle data collection and insight generation.

Senior Software Engineer, AI at Klue | JobZoey