Browse State-of-the-Art › Text to Video Retrieval
Text to Video Retrieval
51 papers with code · 3 benchmarks · 7 datasets archive 2025-07-28
She's gone I can't find her anywhere I'm looking everywhere for her Everywhere is dark
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Kinetics-GEB+ (2 rows) | FROZEN-revised | GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding... | code | — | Compare |
| MSR-VTT (1 row) | CLIP4Clip | CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval | code | Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified | Compare |
| MSVD-Indonesian (1 row) | X-CLIP (Cross-Lingual) | MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesian | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
7 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 75 · with a code link: 51 · where Syntology ran a sample: 22 (16 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (22 of 75 tagged: 16 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 75 of 75, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
22 Apr 2021 5 repositories listed Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)We train VATT end-to-end from scratch using multimodal contrastive losses and evaluate its performance by the downstream tasks of video action recognition, audio event classification, image classification, and…
-
18 Apr 2021 5 repositories listed Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 3 pointer-only (licence)In this paper, we propose a CLIP4Clip model to transfer the knowledge of the CLIP model to video-language retrieval in an end-to-end manner.
-
1 Apr 2021 5 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)Our objective in this work is video-text retrieval - in particular a joint embedding that enables efficient text-to-video retrieval.
-
13 Dec 2019 4 repositories listed Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)Annotating videos is cumbersome, expensive and not scalable.
-
7 Jun 2019 4 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this work, we propose instead to learn such embeddings from video data with readily available natural language annotations in the form of automatically transcribed narrations.
-
19 Mar 2021 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)We present a new state-of-the-art on the text to video retrieval task on MSRVTT and LSMDC benchmarks where our model outperforms all previous solutions by a large margin.
-
29 Oct 2024 2 repositories listedWe show that our system, without joint training, achieves better or comparable results to state-of-the-art models and commercial solutions on multiple text-to-video retrieval benchmarks.
-
22 Nov 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 6 pointer-only (licence)Vision language pre-training aims to learn alignments between vision and language from a large amount of data.
-
7 Jun 2022 2 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 2 pointer-only (licence)Training an effective video-and-language model intuitively requires multiple frames as model inputs.
-
24 Mar 2022 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)Large-scale pretrained image-text models have shown incredible zero-shot performance in a handful of tasks, including video ones such as action recognition and text-to-video retrieval.
-
15 Mar 2022 2 repositories listedRecent dominant methods for video-language pre-training (VLP) learn transferable representations from the raw pixels in an end-to-end manner to achieve advanced performance on downstream video-language retrieval.
-
13 Jan 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 13 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified (of 24 harvested samples) · 6 pointer-only (licence)As an additional benefit, our method achieves competitive results with much shorter pre-training videos on single-modality downstream tasks, e. g., action recognition with linear evaluation.
-
15 Apr 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Partially relevant video retrieval (PRVR) is a practical yet challenging task in text-to-video retrieval, where videos are untrimmed and contain much background content.
-
7 Apr 2025 1 repository listed Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)To filter unnecessary similarity interactions and decrease trainable parameters in the Interactive Similarity Aggregation (ISA) module, we design a Similarity Reorganization (SR) module to identify attentive…
-
13 Mar 2025 1 repository listedText-to-Video Retrieval (TVR) aims to match videos with corresponding textual queries, yet the continual influx of new video content poses a significant challenge for maintaining system performance over time.
-
1 Jan 2024 1 repository listedFor text-to-video retrieval (T2VR) which aims to retrieve unlabeled videos by ad-hoc textual queries CLIP-based methods currently lead the way.
-
1 Jan 2024 1 repository listedTo address this issue, we adopt multi-granularity visual feature learning, ensuring the model's comprehensiveness in capturing visual content features spanning from abstract to detailed levels during the training phase.
-
15 Nov 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)Despite being (pre)trained on a massive amount of data, state-of-the-art video-language alignment models are not robust to semantically-plausible contrastive changes in the video captions.
-
8 Oct 2023 1 repository listedDespite significant results achieved by Contrastive Language-Image Pretraining (CLIP) in zero-shot image recognition, limited effort has been made exploring its potential for zero-shot video recognition.
-
29 Sep 2023 1 repository listed Syntology official (archive's flag): 17 ran · 17 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 5 honoured, 1 violated, 3 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 19 harvested samples) · 8 pointer-only (licence)In this paper, we propose a novel Prototype-based Aleatoric Uncertainty Quantification (PAU) framework to provide trustworthy predictions by quantifying the uncertainty arisen from the inherent data ambiguity.
-
18 Sep 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 4 pointer-only (licence)Specifically, our model captures the cross-modal similarity information at different granularity levels.
-
20 Jun 2023 1 repository listedSince the availability of the pretraining resources with Indonesian sentences is relatively limited, the applicability of those approaches to our dataset is still questionable.
-
23 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)Therefore, we propose MEta Loss TRansformer (MELTR), a plug-in module that automatically and non-linearly combines various loss functions to aid learning the target task via auxiliary learning.
-
4 Feb 2023 1 repository listedThis paper presents a new method for end-to-end Video Question Answering (VideoQA), aside from the current popularity of using large-scale pre-training with huge feature extractors.
-
1 Jan 2023 1 repository listedDuring the knowledge distillation, an inheritance student branch is devised to absorb the knowledge from the teacher model.
-
9 Dec 2022 1 repository listedFurthermore, our model also obtains state-of-the-art video question-answering results on ActivityNet-QA, MSRVTT-QA, MSRVTT-MC and TVQA.
-
21 Nov 2022 1 repository listedIn this paper we tackle the cross-modal video retrieval problem and, more specifically, we focus on text-to-video retrieval.
-
4 Sep 2022 1 repository listedMasked visual modeling (MVM) has been recently proven effective for visual pre-training.
-
26 Aug 2022 1 repository listedTo fill the gap, we propose in this paper a novel T2VR subtask termed Partially Relevant Video Retrieval (PRVR).
-
16 Jul 2022 1 repository listedWe then introduce Clover—a Correlated Video-Language pre-training method—towards a universal Video-Language model for solving multiple video understanding tasks with neither performance nor efficiency compromise.
-
5 Jul 2022 1 repository listed
-
26 Jun 2022 1 repository listed
-
26 Jun 2022 1 repository listed
-
14 Jun 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
11 May 2022 1 repository listed
-
26 Apr 2022 1 repository listed
-
6 Apr 2022 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 5 pointer-only (licence)
-
1 Apr 2022 1 repository listed
-
28 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
23 Jan 2022 1 repository listed
-
3 Dec 2021 1 repository listed
-
24 Nov 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
19 Nov 2021 1 repository listed
-
8 Jun 2021 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
1 Jun 2021 1 repository listed
-
26 Apr 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
11 Feb 2021 1 repository listed
-
3 Aug 2020 1 repository listed
-
6 Mar 2020 1 repository listed
-
Q2E: Query-to-Event Decomposition for Zero-Shot Multilingual Text-to-Video Retrieval11 Jun 2025 0 repositories listed
-
Leveraging Auxiliary Information in Text-to-Video Retrieval: A Review29 May 2025 0 repositories listed
-
Video-ColBERT: Contextualized Late Interaction for Text-to-Video Retrieval24 Mar 2025 0 repositories listed
-
CaReBench: A Fine-Grained Benchmark for Video Captioning and Retrieval31 Dec 2024 0 repositories listed
-
EA-VTR: Event-Aware Video-Text Retrieval10 Jul 2024 0 repositories listed
-
Multi-Granularity and Multi-modal Feature Interaction Approach for Text Video Retrieval21 Jun 2024 0 repositories listed
-
13 May 2024 0 repositories listed
-
Learning text-to-video retrieval from image captioning26 Apr 2024 0 repositories listed
-
Distilling Vision-Language Models on Millions of Videos11 Jan 2024 0 repositories listed
-
Leveraging Generative Language Models for Weakly Supervised Sentence Component Analysis in Video-Language Joint Learning10 Dec 2023 0 repositories listed
-
E-ViLM: Efficient Video-Language Model via Masked Video Modeling with Semantic Vector-Quantized Tokenizer28 Nov 2023 0 repositories listed
-
An Empirical Study of Frame Selection for Text-to-Video Retrieval1 Nov 2023 0 repositories listed
-
TeachCLIP: Multi-Grained Teaching for Efficient Text-to-Video Retrieval2 Aug 2023 0 repositories listed
-
24 Jul 2023 0 repositories listed
-
Temporal Perceiving Video-Language Pre-training18 Jan 2023 0 repositories listed
-
Learning Trajectory-Word Alignments for Video-Language Tasks5 Jan 2023 0 repositories listed
-
9 Dec 2022 0 repositories listed
-
SMAUG: Sparse Masked Autoencoder for Efficient Video-Language Pre-training21 Nov 2022 0 repositories listed
-
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks10 Oct 2022 0 repositories listed
-
15 Apr 2022 0 repositories listed
-
14 Mar 2022 0 repositories listed
-
CUPID: Adaptive Curation of Pre-training Data for Video-and-Language Representation Learning1 Apr 2021 0 repositories listed
-
Support-set bottlenecks for video-text representation learning6 Oct 2020 0 repositories listed
-
Retrieving and Highlighting Action with Spatiotemporal Reference19 May 2020 0 repositories listed
Syntology lines on 24 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections