Research Engineer, Index Intelligence

The role

A research engineer will own the signals and decisions regarding which web pages to index and follow. You will build systems to decide which pages are worth indexing, which links to follow, and how to handle stale or duplicate content.

What you will do

• Own the signals behind indexing decisions
• Make parsing work on pages where it currently does not
• Teach a model to judge page quality
• Work on credibility and misinformation as a modelling problem
• Decide whether two documents are semantically the same or genuinely different to deduplicate the web

Required qualifications

• Hands-on ML experience with classifiers, rankers and calibration
• Strong data instincts at web scale

Nice to have

• Comfortable owning a problem with no ground truth
• Think in end-to-end impact
• Like working across teams
• Care about the problem of finding high quality knowledge

About the company

Exa is an applied AI lab building a search engine. They build massive-scale infra to crawl the web, train embedding models, and design vector databases.