Passage Ranking

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 35 papers with code (73 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Adaptive Re-Ranking with a Corpus Graph
  18 Aug 2022 3 repositories listed
  Search systems often employ a re-ranking pipeline, wherein documents (or passages) from an initial pool of candidates are assigned new ranking scores.
• Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
  21 Jun 2021 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  In particular, based on the pseudo-relevant set of documents identified using a first-pass dense retrieval, we extract representative feedback embeddings (using KMeans clustering) -- while ensuring that these embeddings…
• RepBERT: Contextualized Text Embeddings for First-Stage Retrieval
  28 Jun 2020 3 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  Although exact term match between queries and documents is the dominant method to perform first-stage retrieval, we propose a different approach, called RepBERT, to represent documents and queries with fixed-length…
• Learning to Rank in Generative Retrieval
  27 Jun 2023 2 repositories listed
  However, only learning to generate is insufficient for generative retrieval.
• Shallow pooling for sparse labels
  31 Aug 2021 2 repositories listed
  To test this observation, we employed crowdsourced workers to make preference judgments between the top item returned by a modern neural ranking stack and a judged relevant item.
• Dealing with Typos for BERT-based Passage Retrieval and Ranking
  27 Aug 2021 2 repositories listed
  Our experimental results on the MS MARCO passage ranking dataset show that, with our proposed typos-aware training, DR and BERT re-ranker can become robust to typos in queries, resulting in significantly improved…
• Document Ranking with a Pretrained Sequence-to-Sequence Model
  14 Mar 2020 2 repositories listed
  We investigate this observation further by varying target words to probe the model's use of latent knowledge.
• IRanker: Towards Ranking Foundation Model
  25 Jun 2025 1 repository listed
  We propose to unify these tasks using a single ranking foundation model (FM), as it eliminates the need for designing different models for each specific ranking task.
• Sliding Windows Are Not the End: Exploring Full Ranking with Long-Context Large Language Models
  19 Dec 2024 1 repository listed
  Furthermore, we identify two limitations of fine-tuning the full ranking model based on existing methods: (1) sliding window strategy fails to produce a full ranking list as a training label, and (2) the language…
• CURE: A dataset for Clinical Understanding & Retrieval Evaluation
  9 Dec 2024 1 repository listed
  Given the dominance of dense retrievers that do not generalize well beyond their training dataset distributions, domain-specific test sets are essential in evaluating retrieval.
• DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task
  24 Jun 2024 1 repository listed Syntology ran 13 of 17 samples · 4 unverified · 17 pointer-only (licence)
  However, few studies have explored how to select appropriate in-context demonstrations for the passage ranking task, which is the focus of this paper.
• Leveraging Passage Embeddings for Efficient Listwise Reranking with Large Language Models
  21 Jun 2024 1 repository listed Syntology ran 1 of 4 samples · 3 unverified
  To address these issues, in this paper, we propose PE-Rank, leveraging the single passage embedding as a good context compression for efficient listwise passage reranking.
• Shallow Cross-Encoders for Low-Latency Retrieval
  29 Mar 2024 1 repository listed
  However, Cross-Encoders based on large transformer models (such as BERT or T5) are computationally expensive and allow for scoring only a small number of documents within a reasonably small latency window.
• Fusion-in-T5: Unifying Document Ranking Signals for Improved Information Retrieval
  24 May 2023 1 repository listed
  Common document ranking pipelines in search systems are cascade systems that involve multiple ranking layers to integrate different information step-by-step.
• Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents
  19 Apr 2023 1 repository listed
  In this paper, we first investigate generative LLMs such as ChatGPT and GPT-4 for relevance ranking in IR.
• T2Ranking: A large-scale Chinese Benchmark for Passage Ranking
  7 Apr 2023 1 repository listed
  T2Ranking comprises more than 300K queries and over 2M unique passages from real-world search engines.
• LEAD: Liberal Feature-based Distillation for Dense Retrieval
  10 Dec 2022 1 repository listed
  Knowledge distillation is often used to transfer knowledge from a strong teacher model to a relatively weak student model.
• On the Impact of Speech Recognition Errors in Passage Retrieval for Spoken Question Answering
  26 Sep 2022 1 repository listed
  Finally, we create a new dataset with questions voiced by human users and use their transcriptions to show that the retrieval performance can further degrade when dealing with natural ASR noise instead of synthetic ASR…
• Order-Disorder: Imitation Adversarial Attacks for Black-box Neural Ranking Models
  14 Sep 2022 1 repository listed
  In this study, we propose an imitation adversarial attack on black-box neural passage ranking models.
• Sparse Pairwise Re-ranking with Pre-trained Transformers
  10 Jul 2022 1 repository listed
  Pairwise re-ranking models predict which of two documents is more relevant to a query and then aggregate a final ranking from such preferences.
• HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking
  21 May 2022 1 repository listed
  Existing text retrieval systems with state-of-the-art performance usually adopt a retrieve-then-reranking architecture due to the high computational cost of pre-trained language models and the large corpus size.
• Analysing the Robustness of Dual Encoders for Dense Retrieval Against Misspellings
  4 May 2022 1 repository listed
  Dense retrieval is becoming one of the standard approaches for document and passage ranking.
• Text and Code Embeddings by Contrastive Pre-Training
  24 Jan 2022 1 repository listed
  Similarly to text embeddings, we train code embedding models on (text, code) pairs, obtaining a 20.
• mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset
  31 Aug 2021 1 repository listed
  In this work, we present mMARCO, a multilingual version of the MS MARCO passage ranking dataset comprising 13 languages that was created using machine translation.
• On Approximate Nearest Neighbour Selection for Multi-Stage Dense Retrieval
  25 Aug 2021 1 repository listed
  In this work, we investigate the use of ANN scores for ranking the candidate documents, in order to decrease the number of candidate documents being fully scored.
• Query Embedding Pruning for Dense Retrieval
  23 Aug 2021 1 repository listed
  Recent advances in dense retrieval techniques have offered the promise of being able not just to re-rank documents using contextualised language models such as BERT, but also to use such models to identify documents…
• Exploiting Sentence-Level Representations for Passage Ranking
  14 Jun 2021 1 repository listed
  Recently, pre-trained contextual models, such as BERT, have shown to perform well in language related tasks.
• A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answering
  13 Oct 2020 1 repository listed
  The dependency between an adequate question formulation and correct answer selection is a very intriguing but still underexplored area.
• Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation
  6 Oct 2020 1 repository listed
  Based on this finding, we propose a cross-architecture training procedure with a margin focused loss (Margin-MSE), that adapts knowledge distillation to the varying score output distributions of different BERT and…
• Expansion via Prediction of Importance with Contextualization
  29 Apr 2020 1 repository listed
  We also observe that the performance is additive with the current leading first-stage retrieval methods, further narrowing the gap between inexpensive and cost-prohibitive passage ranking approaches.

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.