AI Engineer

The role

The AI Engineer will own the prompts, agents, evals, and pipelines for user-facing features. You will turn product requirements into working AI systems and iterate until they are production-ready.

What you will do

• Build new AI features end to end, from prototype to production.
• Improve AI output quality through prompt engineering, model selection, retrieval, and evaluation.
• Design and run evals that measure real output quality.
• Iterate fast on prompts, agent designs, and orchestration patterns.
• Partner with the Product Engineer to translate requirements into AI features.
• Partner with the AI Platform team to land features on solid infrastructure.
• Evaluate new models, tools, and techniques to improve quality, latency, cost, or reliability.

Required qualifications

• Hands-on experience building LLM-powered features that shipped to real users
• Production engineering chops in TypeScript/Node (primary, especially in AWS Lambda) and/or Python
• Experience with multiple LLM providers such as Anthropic, OpenAI, Google Vertex, AWS Bedrock, or similar
• Practical judgment in prompt engineering, retrieval, and agent design, backed by evaluation results
• Track record of building evaluation systems that actually catch regressions
• Solid software engineering fundamentals

Nice to have

• Experience with provider-abstraction libraries for multi-LLM workflows
• Familiarity with pgvector or other vector retrieval systems
• Experience with post-training or fine-tuning
• Experience deploying AI features on AWS Lambda, ECS Fargate, or similar
• Background in ML, NLP, or applied research
• Experience with structured output, function calling, and tool use at scale
• Experience with Anyscale Ray or similar distributed compute frameworks
• Open source contributions in the LLM or agent tooling space

Benefits

• Base salary: US$180,000 to US$250,000
• ESOP
• US$1,000 per month food and commuting allowance
• Laptop of choice

Before you apply

• E-3 sponsorship is offered for Australians to relocate with stipend
• Resume screen
• 1:1 with founder
• Technical deep-dive on past AI engineering work
• Work through a real problem with the team

About the company

Fluency builds a platform that captures how work actually happens inside large organizations, measures productivity and process conformance, and analyzes where AI can do the work.