Text Retrieval

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

16 leaderboard tables shown for this task, 16 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 16 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

37 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 37 until expanded.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 335 papers with code (671 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  28 Jan 2022 9 repositories listed
  Furthermore, performance improvement has been largely achieved by scaling up the dataset with noisy image-text pairs collected from the web, which is a suboptimal source of supervision.
• Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering
  10 Nov 2019 7 repositories listed Syntology ran 4 of 6 samples · 2 unverified · 4 pointer-only (licence)
  We introduce an approach for open-domain question answering (QA) that retrieves and reads a passage graph, where vertices are passages of text and edges represent relationships that are derived from an external…
• UNITER: UNiversal Image-TExt Representation Learning
  25 Sep 2019 7 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  Different from previous work that applies joint random masking to both modalities, we use conditional masking on pre-training tasks (i.
• LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  3 Oct 2023 6 repositories listed Syntology ran 7 of 14 samples · 7 unverified
  We thus propose VIDAL-10M with Video, Infrared, Depth, Audio and their corresponding Language, naming as VIDAL-10M.
• FlexiViT: One Model for All Patch Sizes
  15 Dec 2022 6 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  Vision Transformers convert images to sequences by slicing them into patches.
• Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
  16 Jul 2021 6 repositories listed Syntology ran 3 of 5 samples · 2 unverified · 3 pointer-only (licence)
  Most existing methods employ a transformer-based multimodal encoder to jointly model visual tokens (region-based image features) and word tokens.
• Language-agnostic BERT Sentence Embedding
  3 Jul 2020 6 repositories listed
  While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings…
• Stacked Cross Attention for Image-Text Matching
  21 Mar 2018 6 repositories listed Syntology ran 7 of 16 samples · 9 unverified · 1 pointer-only (licence)
  Prior work either simply aggregates the similarity of all possible pairs of regions and words without attending differentially to more and less important words or regions, or uses a multi-step attentional process to…
• MTEB: Massive Text Embedding Benchmark
  13 Oct 2022 5 repositories listed Syntology ran 3 of 13 samples · 10 unverified
  MTEB spans 8 embedding tasks covering a total of 58 datasets and 112 languages.
• CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
  18 Apr 2021 5 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 3 pointer-only (licence)
  In this paper, we propose a CLIP4Clip model to transfer the knowledge of the CLIP model to video-language retrieval in an end-to-end manner.
• Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
  1 Apr 2021 5 repositories listed Syntology ran 3 of 11 samples · 8 unverified
  Our objective in this work is video-text retrieval - in particular a joint embedding that enables efficient text-to-video retrieval.
• Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
  11 Feb 2021 5 repositories listed Syntology ran 8 of 10 samples · 2 unverified · 9 pointer-only (licence)
  In this paper, we leverage a noisy dataset of over one billion image alt-text pairs, obtained without expensive filtering or post-processing steps in the Conceptual Captions dataset.
• Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
  1 Jul 2020 5 repositories listed Syntology ran 3 of 12 samples · 9 unverified
  In this paper, we identify that the main bottleneck is in the training mechanisms, where the negative instances used in training are not representative of the irrelevant documents in testing.
• Learning a Text-Video Embedding from Incomplete and Heterogeneous Data
  7 Apr 2018 5 repositories listed
  We evaluate our method on the task of video retrieval and report results for the MPII Movie Description and MSR-VTT datasets.
• Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling
  14 Apr 2021 4 repositories listed
  A vital step towards the widespread adoption of neural retrieval models is their resource efficiency throughout the training, indexing and query workflows.
• Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning
  1 Mar 2020 4 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  To improve fine-grained video-text retrieval, we propose a Hierarchical Graph Reasoning (HGR) model, which decomposes video-text matching into global-to-local levels.
• BM25S: Orders of magnitude faster lexical search via eager sparse scoring
  4 Jul 2024 3 repositories listed Syntology ran 10 of 22 samples · 12 unverified
  We introduce BM25S, an efficient Python-based implementation of BM25 that only depends on Numpy and Scipy.
• RETSim: Resilient and Efficient Text Similarity
  28 Nov 2023 3 repositories listed
  This paper introduces RETSim (Resilient and Efficient Text Similarity), a lightweight, multilingual deep learning model trained to produce robust metric embeddings for near-duplicate text retrieval, clustering, and…
• X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
  15 Jul 2022 3 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 1 pointer-only (licence)
  However, cross-grained contrast, which is the contrast between coarse-grained representations and fine-grained representations, has rarely been explored in prior research.
• mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
  24 May 2022 3 repositories listed
  Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks.
• BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
  17 Apr 2021 3 repositories listed Syntology ran 3 of 4 samples · 1 unverified
  To address this, and to facilitate researchers to broadly evaluate the effectiveness of their models, we introduce Benchmarking-IR (BEIR), a robust and heterogeneous evaluation benchmark for information retrieval.
• Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  7 Apr 2021 3 repositories listed
  As region-based visual features usually represent parts of an image, it is challenging for existing vision-language models to fully understand the semantics from paired natural languages.
• WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learning
  2 Mar 2021 3 repositories listed
  First, WIT is the largest multimodal dataset by the number of image-text examples by 3x (at the time of writing).
• Image Chat: Engaging Grounded Conversations
  2 Nov 2018 3 repositories listed
  To test such models, we collect a dataset of grounded human-human conversations, where speakers are asked to play roles given a provided emotional mood or style, as the use of such traits is also a key factor in…
• Single Shot Scene Text Retrieval
  27 Aug 2018 3 repositories listed
  In this way, the text based image retrieval task can be casted as a simple nearest neighbor search of the query text representation over the outputs of the CNN over the entire image database.
• Variational Deep Semantic Hashing for Text Documents
  11 Aug 2017 3 repositories listed
  Especially, deep generative models naturally combine the expressiveness of probabilistic generative models with the high capacity of deep neural networks, which is very suitable for text modeling.
• M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP
  28 Mar 2025 2 repositories listed
  In the second stage, it learns CLAP features using the audio features learned from the LLM-based embeddings.
• BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature
  13 Jan 2025 2 repositories listed Syntology ran 0 of 20 samples · 20 unverified
  The development of vision-language models (VLMs) is driven by large-scale and diverse multimodal datasets.
• Gramian Multimodal Representation Learning and Alignment
  16 Dec 2024 2 repositories listed Syntology ran 2 of 12 samples · 10 unverified
  These models typically align each modality to a designated anchor without ensuring the alignment of all modalities with each other, leading to suboptimal performance in tasks requiring a joint understanding of multiple…
• RWKV-CLIP: A Robust Vision-Language Representation Learner
  11 Jun 2024 2 repositories listed Syntology ran 7 of 14 samples · 7 unverified
  Contrastive Language-Image Pre-training (CLIP) has significantly improved performance in various vision-language tasks by expanding the dataset with image-text pairs obtained from websites.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.