AI Engineer

The role

You will design, build, and operate LLM powered systems that are reliable, scalable, and integrated into product workflows. This involves working across the stack, including designing AI systems, building backend infrastructure, and implementing product features.

What you will do

• Design and implement systems that integrate LLMs into real product workflows.
• Develop robust systems that account for model limitations and failure modes.
• Build safeguards, retries, evaluation loops, and observability into LLM powered features.
• Create evaluation datasets and tooling to measure model performance.
• Design and optimize retrieval pipelines that power LLM applications.
• Collaborate with product, design, and engineering teammates to build features.
• Write clean, maintainable, well tested code.
• Contribute to system architecture, code reviews, and engineering processes.

Required qualifications

• At least five years of experience building production systems.
• Experience building systems around large language models in production environments.
• Experience designing prompts, managing context, orchestrating tool usage, and improving model outputs.
• Experience building evaluation frameworks and designing datasets.
• Experience with retrieval augmented generation systems.
• Experience working with embeddings, vector databases, and semantic search.
• Understanding of how modern language models work at a conceptual level.
• Understanding of transformers, attention mechanisms, and model architecture tradeoffs.
• Understanding of LLM strengths and weaknesses including hallucinations, prompt sensitivity, context limits, latency, and cost.

Benefits

• Competitive salary
• Meaningful equity
• Choice of hardware and setup
• Flexible paid time off

About the company

Ravenna is an early stage company building modern, intelligent product experiences by combining large language models with machine learning techniques.