Guide : Reranking

Reranking is the second stage of a retrieval pipeline — how bi-encoders and cross-encoders reorder retrieved results by relevance avant they're served or handed to an LLM, and ce que que signifie pour AI search visibility.

Première publication : 3 juil. 2026 · Dernière mise à jour : 3 août 2026 · Advanced
Langues

Reranking is the second stage of a retrieval pipeline: a cheap, broad premier réussir retrieves a candidate définir of documents or passages, alors a slower, plus precise model re-scores and reorders que shortlist avant results are served or fed to an LLM. The core mechanic is bi-encoder vs cross-encoder — a bi-encoder encodes the requête and document separately into vectors and compares les (fast, scalable, moins precise), pendant que a cross-encoder encodes les ensemble and scores the pair directement (slower, plus accurate). Vous pouvez't score a whole billion-page corpus with the expensive model, so vous retrieve broadly and rerank the shortlist. Google doesn't utiliser the word 'reranking' publicly, but its named BERT and passage-ranking systems do the job, and Microsoft documents an explicit Bing-derived reranker in Azure AI Search. Reranking n’est pas the même as Reciprocal Rank Fusion. The SEO upshot: parce que rerankers score query-passage pairs jointly, self-contained, unambiguous passages que lire as a direct réponse score meilleur.

TL;DR — Reranking is the second stage of a two-stage (or multi-stage) retrieval pipeline: a cheap, broad retrieval réussir (BM25 keyword match, embedding/vector similarity, or les deux) pulls a candidate définir, alors a slower, plus precise model re-scores and reorders que shortlist. The core mechanic is bi-encoder vs cross-encoder — a bi-encoder encodes requête and document separately into vectors and compares les (fast, precomputable, moins precise); a cross-encoder encodes les ensemble and outputs un relevance score per pair (slower, can’t be precomputed, plus accurate). Vous pouvez’t run a cross-encoder over a whole corpus, so vous retrieve broadly and rerank the shortlist. Google doesn’t dire “reranking” publicly, but BERT and passage ranking do the job; Microsoft documents an explicit Bing-derived reranker in Azure AI Search. Reranking ≠ Reciprocal Rank Fusion (RRF). SEO upshot: rerankers score query-passage pairs jointly, so self-contained, unambiguous passages win.

Evidence for this claim A cross-encoder can score query-document pairs for reranking after an initial retrieval stage. Scope: Sentence-BERT evaluation and related retrieve-then-rerank use; cross-encoders are one reranking approach, not a universal implementation. Confidence: high · Verified: Reimers and Gurevych: Sentence-BERT

The retrieve-then-rerank pattern

Two-stage retrieval trades candidate breadth contre plus expensive scoring. Evidence for this claim A cross-encoder can score query-document pairs for reranking after an initial retrieval stage. Scope: Sentence-BERT evaluation and related retrieve-then-rerank use; cross-encoders are one reranking approach, not a universal implementation. Confidence: high · Verified: Reimers and Gurevych: Sentence-BERT Model choice and latency-quality tradeoffs are implementation-specific. Evidence for this claim A rerank model can reorder an existing candidate list by relevance to a query. Scope: Cohere's Rerank product behavior; inputs, limits, and scoring semantics are vendor-specific. Confidence: high · Verified: Cohere: Rerank overview

Reranking changes the order only after retrieval creates the candidate set. Source : Reranking

A query enters fast first-stage retrieval, which produces a candidate shortlist. A slower query-candidate scoring model reranks only that shortlist into the final order. A document omitted by retrieval never reaches the reranker.

© Patrick Stox LLC · CC BY 4.0 ·

Every large-scale relevance system faces the même problem: vous pouvez’t afford to run votre la plupart accurate relevance model on votre entier corpus. So the standard solution is to split the fonctionner into stages. Google Cloud’s propre search documentation states the logic plainly: “En bref, retrieval is finding relevant documents, pendant que ranking is ordering ceux retrieved documents. Ranking tout the disponible documents peut be computationally expensive. Therefore, retrieval and ranking fonctionner sequentially.” (Google Cloud, “About retrieval and ranking”)

Stage un — retrieval — casts a wide net cheaply. It uses lexical matching (BM25 over an inverted index), embedding-based vector search, or a hybrid of the two, and renvoie a candidate définir. Stage two — reranking — takes que shortlist and re-scores every candidate with a plus expensive, higher-precision model, alors reorders. The one-line version everyone converges on: retrieve cheaply and broadly, rerank precisely on a petit définir, alors serve or generate.

Bi-encoders vs cross-encoders: the core mechanic

The whole topic hinges on un architectural distinction — quand the requête and the document meet.

  • Bi-encoder (the first-stage retriever). It encodes the requête and chaque document separately, chaque into its propre vector, and alors compares the two vectors with something comme cosine similarity. Parce que the document vectors don’t depend on the requête, vous pouvez compute and index les ahead of temps, qui is ce que rend retrieval fast suffisant to run à travers an entier corpus. The cost: requête and document jamais en réalité interact, so the model has to, in effect, compress every possible meaning of a document into a unique vector — and nuance obtient lost. Bi-encoders are ce que embeddings and vector search are construit on.
  • Cross-encoder (the stage-two reranker). It encodes the requête and un candidate document ensemble, as a unique joint input via a transformer, and outputs a unique relevance score pour que pair. Parce que the model sees les deux at une fois, it peut directement weigh how the spécifique words of the requête relate to the spécifique words of the document — far plus accurate. The cost: nothing peut be precomputed. Every query-document pair has to be run via the model at requête temps, so it’s far aussi slow to appliquer to a whole index. That’s precisely pourquoi it’s reserved pour the shortlist.

Google, notably, describes ce exact mechanism in its propre words. In the Google Cloud retrieval/ranking docs, un of the listed retrieval signals is cross-attention, défini as something que “permet a model to considérer the relationship entre a requête and a document to assign a relevance score to the document.” Que is the cross-encoder idea sous a différent nom.

Pourquoi pas simplement utiliser the accurate model on everything?

Latency and cost faire it infeasible at scale, and the gap is enormous, pas marginal. Pinecone’s write-up on two-stage retrieval puts a concrete number on it: on a 40-million-record définir, running a BERT-style cross-encoder reranker over everything on a V100 GPU voudrait prendre plus que 50 hours, versus sous 100 milliseconds pour vector search. (Pinecone, “Rerankers and Two-Stage Retrieval”) That’s the entier justification pour the two-stage design — vous obtenir la plupart of the cross-encoder’s accuracy pendant que seulement paying its cost on a few dozen or few hundred candidates.

Vectara frames the même myth directement — the question of pourquoi pas simplement score tout documents with the la plupart precise model si it’s disponible — and the réponse is the même: vous pouvez’t, so vous filter cheaply premier. (Vectara, “What is reranking and why does it matter?”)

How Google fait ce

Google has jamais publié an official statement en utilisant the terms “reranking,” “cross-encoder,” or “bi-encoder” à propos de Recherche Google itself — worth stating plainly so we don’t overclaim. But the function is documented sous autre noms.

Google’s propre Guide to Recherche Google Ranking Systems noms two systems que do reranking’s job:

  • BERT“an AI system Google uses que permet us to comprendre how combinations of words express différent meanings and intent.” BERT jointly reads the words of a requête in context; a BERT-based reranker scores query-document relevance the façon a cross-encoder fait.
  • Passage ranking“an AI system we utiliser to identifier individual sections or ‘passages’ of a web page to meilleur comprendre how relevant une page is to a search.” That’s reranking at the passage level plutôt que lune page level (voir passage ranking pour the deep dive).
  • RankBrain — Google’s précédent system que “helps us comprendre how words are connexe to concepts,” so it peut retourner relevant content même sans exact-match words.

Google Research has aussi publié the mechanism outright: its paper Learning-to-Rank with BERT in TF-Ranking describes encoding requêtes and documents with BERT and applying a learning-to-rank couche on top, and explicitly frames it as passage re-ranking — reporting the meilleur performances on the MS MARCO passage re-ranking task as of March 30, 2020. That’s a Google Research publication plutôt que Search Central product guidance, so treat it as Google’s technical research, pas a statement à propos de the live Search pipeline.

Un number worth hedging: the “cut down to the top 1,000 results, then reorder them” framing que circulates widely in SEO traces back to my propre conference deck’s interpretation of public research and patents — pas a current, verbatim Google statement à propos de web Search. Google Cloud’s enterprise search product fait document a concrete pipeline (“the model retrieves documents in the order of thousands… The ranking model alors orders the retrieved documents and sert the top 400 ranked results”), but that’s the Vertex AI Search product, pas Google web Search. Don’t assume soit the 1 000 or the 400 s’applique to Recherche Google itself.

How Bing/Microsoft fait ce

Microsoft is beaucoup plus explicit, and its clearest documentation is the closest chose to an official production-reranker description you’ll trouver. Azure AI Search’s semantic ranker is documented as “a fonctionnalité que measurably improves search relevance by en utilisant Microsoft’s language understanding models to rerank résultats de recherche” — and crucially, “the underlying technology is from Bing and Microsoft Research.”

The mechanics map cleanly onto the two-stage pattern:

  • It “toujours adds secondary ranking over an initial result définir que was scored en utilisant BM25 or Reciprocal Rank Fusion (RRF).” Stage un is BM25 or RRF; the semantic ranker is stage two.
  • Microsoft calls que stage L2 ranking, qui “uses the context or semantic meaning of a requête to compute a nouveau relevance score over preranked results.”
  • It seulement reranks the shortlist, jamais the whole corpus: “Ce que semantic ranker can’t do is rerun the requête over the entier corpus… Semantic ranking reranks the existing result définir, consisting of the top 50 results as scored by the par défaut ranking algorithm.” Even if more than 50 results come back, “seulement the top 50 results progress to semantic ranking.”

Bing’s propre May 2026 blog on the evolving role of the index doesn’t nom reranking directement, but reinforces que retrieval quality is now judged by answer-support reliability: “Retrieval systems doit therefore optimize pas simplement pour one-shot retrieval, but pour consistent, repeatable behavior à travers iterative utiliser.”

Ce is où reranking touches AI Overviews, AI Mode, Copilot, ChatGPT Search, and Perplexity la plupart directement. In a RAG pipeline, reranking is a named stage entre retrieval and generation: content is chunked, chaque chunk is embedded and stored, the requête retrieves nearby chunks by vector similarity, a reranker re-scores ceux candidates, and seulement the top survivors obtenir handed to the LLM as context. The reranker is the gate entre “your passage was retrieved” and “your passage was actually used.”

Que gate peut be strict. In AI-search systems, seulement a fraction of retrieved sources typically clair the rerank threshold into the generation stage — so being pulled into the candidate pool is the price of entry, pas a guarantee of a citation. As Ahrefs’ propre research on optimizing pour LLM search frames the core problem: “AI companies don’t reveal how LLMs select sources, so it’s hard to know how to influence leur outputs.” Reranking is a big partie of que hidden selection step.

Reranking vs. Reciprocal Rank Fusion (RRF)

Ces obtenir conflated constantly — notamment in otherwise-good SEO content — and they’re pas the même mechanism.

  • Reranking rescores un candidate pool by jointly evaluating chaque query-document pair with a unique model (the cross-encoder). It demande: how relevant is ce document to ce requête, really?
  • Reciprocal Rank Fusion (RRF) merges multiple already-ranked listes — Par exemple, le résultats from BM25 and le résultats from vector search, or le résultats from several fan-out sub-queries — by rewarding documents que apparaître consistently à travers listes. Ahrefs’ Requête Fan-Out explainer describes it: fan-out requêtes are searched à travers indexes “en utilisant reciprocal rank fusion (RRF) — a méthode que scores and merges multiple listes of results by rewarding ceux que apparaître consistently à travers les.”

Les deux peut live in the même pipeline — Azure’s semantic ranker literally reranks on top of a BM25- or RRF-ranked définir — but RRF is a list-merging step (aucun model reads votre content), pendant que reranking is a content-scoring step (a model reads the requête and votre passage ensemble). Si vous prendre un disambiguation away: RRF combines listes; reranking re-reads content.

A brief history: BM25 → RankBrain → BERT → LLM rerankers

Reranking isn’t nouveau — it’s the modern nom pour a pattern search has utilisé pour années. The throughline, qui I walk via in my Ahrefs Evolve 2025 talk GEO? AEO? LLMO? What’s With Tout Ce AI Stuff?:

  • BM25 / lexical retrieval — the classic keyword-match scoring que encore fait first-pass narrowing.
  • RankBrain (2016) — Google’s premier machine-learning ranking system, understanding words as concepts.
  • BERT / DeepRank (2019) — contextual, passage-level language understanding; the cross-encoder-style reranking era begins.
  • Modern LLM-based rerankers (RankEmbed and RAG-era cross-encoders) — neural rerankers now sit entre retrieval and generation à travers AI search.

The consistent shape à travers tout of les: cheap broad retrieval premier, expensive precise reordering of a shortlist second.

Ce que cela signifie pour content and SEO

Parce que a cross-encoder scores the requête and votre passage jointly, the practical implications reinforce meilleur practices vous déjà know — now with a mechanism behind les:

  • Écrire self-contained passages. A reranker scores a passage largely on its propre merits contre the requête. A section que seulement rend sense in the context of the three paragraphs ci-dessus it scores worse que un que reads as a complet réponse. Ce ties directement to passage ranking and chunking.
  • Réponse the spécifique question, near the top of the section. Direct réponses score meilleur que build-up. Put the réponse premier, alors elaborate.
  • Minimize ambiguity. Pronouns and context-dependent phrasing (“as mentioned above,” “this approach”) que seulement resolve elsewhere on lune page faire a passage harder to score in isolation. Nom the chose.
  • Retrieval is encore the prerequisite. Reranking seulement ever sees ce que retrieval hands it. Une page que can’t be crawled and indexé, or que jamais obtient retrieved, jamais reaches the reranker at tout. Fix findability premier; optimize passages second.

None of ce is a knob vous submit to Google. It’s the même “be clear and be found” advice, aimed at the spécifique stage — the second regarder — que decides qui retrieved content en réalité obtient utilisé.

Add an expert note

Pin an expert quote

New person? Create their unclaimed profile at /admin/experts/ → Pin a quote first.