Senior Staff Software Engineer- Search Quality

The role

You will own the quality of results for AI Agents and human users. You will optimize the retrieval layer for LLMs and improve traditional search experiences.

What you will do

• Own the quality of results for AI Agents and human users
• Optimize the retrieval layer for LLMs to ensure ground truth for business actions
• Improve the traditional search experience for employees
• Balance keyword-based search with semantic vector search
• Fine-tune ranking models for human readability and LLM-ready context
• Build guardrails and relevance scoring to prevent hallucinations
• Connect structured SQL tables, unstructured docs, and real-time business metrics

Required qualifications

• Knowledge of Lucene/Elasticsearch, embeddings, and ranking algorithms
• Understanding of building evaluation frameworks (human-in-the-loop and LLM-based)
• Knowledge of relevance metrics (nDCG, MRR, Precision@K)

Nice to have

• Excitement to apply traditional Information Retrieval (IR) wisdom to Retrieval-Augmented Generation (RAG)

About the company

Databricks is the Data and AI company. More than 20,000 organizations worldwide rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents.