Browse State-of-the-Art › Moment Retrieval
Moment Retrieval
76 papers with code · 2 benchmarks · 6 datasets archive 2025-07-28
Moment retrieval can de defined as the task of "localizing moments in a video given a user query".
Description from: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries
Image credit: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 5 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): QVHighlights (1 judged, 0 placed), Charades-STA (4 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| QVHighlights (32 rows) | SG-DETR (w/ PT) | Saliency-Guided DETR for Moment Retrieval and Highlight Detection | code | — | Compare |
| Charades-STA (25 rows) | SG-DETR (w/ PT) | Saliency-Guided DETR for Moment Retrieval and Highlight Detection | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
6 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 132 · with a code link: 76 · where Syntology ran a sample: 33 (29 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (33 of 132 tagged: 29 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 132, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
20 Jul 2021 4 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 1 pointer-only (licence)Each video in the dataset is annotated with: (1) a human-written free-form NL query, (2) relevant moments in the video w. r. t.
-
23 Mar 2022 3 repositories listedFinding relevant moments and highlights in videos according to natural language queries is a natural and highly valuable common need in the current video content explosion era.
-
1 May 2020 3 repositories listed Syntology official (archive's flag): 8 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 8 pointer-only (licence)We present HERO, a novel framework for large-scale video+language omni-representation learning.
-
22 Mar 2024 2 repositories listedWe introduce InternVideo2, a new family of video foundation models (ViFM) that achieve the state-of-the-art results in video recognition, video-text tasks, and video-centric dialogue.
-
15 Nov 2023 2 repositories listed Syntology official (archive's flag): 7 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)Dummy tokens conditioned by text query take portions of the attention weights, preventing irrelevant video clips from being represented by the text query.
-
24 Jan 2020 2 repositories listed Syntology official (archive's flag): 19 ran · 19 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 0 violated, 9 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 19 harvested samples) · 3 pointer-only (licence)The queries are also labeled with query types that indicate whether each of them is more related to video or subtitle or both, allowing for in-depth analysis of the dataset and the methods that built on top of it.
-
30 Jul 2019 2 repositories listed Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)We evaluate our approach on two recently proposed datasets for temporal localization of moments in video with natural language (DiDeMo and Charades-STA) extended to our video corpus moment retrieval setting.
-
9 Mar 2025 1 repository listedTemporal localization in untrimmed videos, which aims to identify specific timestamps, is crucial for video understanding but remains challenging.
-
12 Feb 2025 1 repository listedVideo Moment Retrieval is a common task to evaluate the performance of visual-language models - it involves localising start and end times of moments in videos from query sentences.
-
18 Jan 2025 1 repository listedExisting models usually first use contrastive learning methods to align video and text features, then fuse and extract multimodal information, and finally use a Transformer Decoder to decode multimodal information.
-
9 Jan 2025 1 repository listedRetrieved segments are then merged into coarse-grained moment proposals.
-
5 Jan 2025 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 10 pointer-only (licence)In this paper, we present a novel Video Context-aware Keyword Attention module that overcomes this limitation by capturing keyword variation within the context of the entire video.
-
1 Jan 2025 1 repository listedVideo moment retrieval aims to locate specific moments from a video according to the query text.
-
1 Jan 2025 1 repository listedWe identify three critical challenges: (C1) insufficient quantitative representation of textual numerical data, (C2) repetitive and degraded response templates for spatiotemporal referencing, and (C3) loss of visual…
-
30 Dec 2024 1 repository listedVideo Moment Retrieval (MR) aims to localize moments within a video based on a given natural language query.
-
18 Dec 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 2 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 13 pointer-only (licence)For short-moment retrieval, FlashVTG increases mAP to 125% of previous SOTA performance.
-
2 Dec 2024 1 repository listedVideo Highlight Detection and Moment Retrieval (HD/MR) are essential in video analysis.
-
1 Dec 2024 1 repository listedTo support this, we introduce Video Moment Retrieval Pretraining (Vid-Morp), a large-scale dataset collected with minimal human intervention, consisting of over 50K videos captured in the wild and 200K pseudo…
-
21 Nov 2024 1 repository listedHowever, long video processing and precise moment retrieval remain challenging due to LLMs' limited context size and coarse frame extraction.
-
15 Nov 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified (of 11 harvested samples) · 3 pointer-only (licence)Video Large Language Models (Vid-LLMs) have made remarkable advancements in comprehending video content for QA dialogue.
-
25 Oct 2024 1 repository listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)This paper proposes TimeSuite, a collection of new designs to adapt the existing short-form video MLLMs for long video understanding, including a simple yet efficient framework to process long video sequence, a…
-
11 Oct 2024 1 repository listedIn this paper, we propose a more challenging fine-grained VCMR benchmark requiring methods to localize the best-matched moment from the corpus with other partially matched candidates.
-
2 Oct 2024 1 repository listedCombined with the introduced Saliency-Guided Cross Attention mechanism and a hybrid DETR architecture, our approach significantly enhances performance in both moment retrieval and highlight detection tasks.
-
27 Sep 2024 1 repository listedGuiding users through complex procedural plans is an inherently multimodal task in which having visually illustrated plan steps is crucial to deliver an effective plan guidance.
-
24 Sep 2024 1 repository listedAdditionally, we provide manually annotated datasets to properly measure the effectiveness and robustness of our methods on real data.
-
6 Aug 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 7 pointer-only (licence)Lighthouse addresses these issues by implementing a unified reproducible codebase that includes six models, three features, and five datasets.
-
21 Jul 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 9 pointer-only (licence)Through a feasibility study, we demonstrate that LLM encoders effectively refine inter-concept relations in multimodal embeddings, even without being trained on textual embeddings.
-
9 Jul 2024 1 repository listedTo facilitate research in RVMR, we develop the TVR-Ranking dataset, based on the raw videos and existing moment annotations provided in the TVR dataset.
-
6 Jul 2024 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 13 pointer-only (licence)Temporal grounding, also known as video moment retrieval, aims at locating video segments corresponding to a given query sentence.
-
26 Jun 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)We achieve a new state-of-the-art in moment retrieval on the widely used benchmarks Charades-STA, QVHighlights, and ActivityNet Captions.
-
22 May 2024 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 10 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples)
-
21 Apr 2024 1 repository listed
-
14 Apr 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
7 Apr 2024 1 repository listed
-
2 Apr 2024 1 repository listed
-
31 Mar 2024 1 repository listed
-
14 Mar 2024 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 2 pointer-only (licence)
-
21 Feb 2024 1 repository listed
-
4 Jan 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 5 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
19 Dec 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)
-
12 Dec 2023 1 repository listed
-
30 Nov 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
28 Nov 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 6 pointer-only (licence)
-
1 Sep 2023 1 repository listed
-
21 Aug 2023 1 repository listed
-
15 Aug 2023 1 repository listed
-
31 Jul 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 2 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 5 pointer-only (licence)
-
6 Jul 2023 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
5 Jun 2023 1 repository listed
-
8 May 2023 1 repository listed
-
6 Apr 2023 1 repository listed
-
29 Mar 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 3 pointer-only (licence)
-
24 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
12 Mar 2023 1 repository listed
-
1 Jan 2023 1 repository listed
-
1 Jan 2023 1 repository listed
-
8 Nov 2022 1 repository listed
-
23 Oct 2022 1 repository listed
-
17 Oct 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 18 unverified (of 24 harvested samples)
-
26 Aug 2022 1 repository listed
-
25 May 2022 1 repository listed
-
20 Apr 2022 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
1 Dec 2021 1 repository listed
-
1 Dec 2021 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
21 Sep 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
30 Jul 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
3 Jun 2021 1 repository listed
-
13 May 2021 1 repository listed Syntology 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 5 pointer-only (licence)
-
22 Sep 2020 1 repository listed
-
24 Aug 2020 1 repository listed
-
19 Aug 2020 1 repository listed
-
6 Jun 2019 1 repository listed
-
5 Apr 2019 1 repository listed
-
Retrieval Augmented Generation Evaluation for Health Documents7 May 2025 0 repositories listed
-
Grounding-MD: Grounded Video-language Pre-training for Open-World Moment Detection20 Apr 2025 0 repositories listed
-
Towards Efficient and Robust Moment Retrieval System: A Unified Framework for Multi-Granularity Models and Temporal Reranking11 Apr 2025 0 repositories listed
-
MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrieval18 Feb 2025 0 repositories listed
-
Multi-modal Fusion and Query Refinement Network for Video Moment Retrieval and Highlight Detection18 Jan 2025 0 repositories listed
-
Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models14 Jan 2025 0 repositories listed
-
13 Jan 2025 0 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 8 pointer-only (licence)
-
DAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments28 Dec 2024 0 repositories listed
-
Query-centric Audio-Visual Cognition Network for Moment Retrieval, Segmentation and Step-Captioning18 Dec 2024 0 repositories listed
-
Agent-based Video Trimming12 Dec 2024 0 repositories listed
-
EAGLE: Egocentric AGgregated Language-video Engine26 Sep 2024 0 repositories listed
-
D&M: Enriching E-commerce Videos with Sound Effects by Key Moment Detection and SFX Matching23 Aug 2024 0 repositories listed
-
QD-VMR: Query Debiasing with Contextual Understanding Enhancement for Video Moment Retrieval23 Aug 2024 0 repositories listed
-
Disentangle and denoise: Tackling context misalignment for video moment retrieval14 Aug 2024 0 repositories listed
-
SLVideo: A Sign Language Video Moment Retrieval Framework22 Jul 2024 0 repositories listed
-
Multi-sentence Video Grounding for Long Video Generation18 Jul 2024 0 repositories listed
-
EA-VTR: Event-Aware Video-Text Retrieval10 Jul 2024 0 repositories listed
-
MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval25 Jun 2024 0 repositories listed
-
2DP-2MRC: 2-Dimensional Pointer-based Machine Reading Comprehension Method for Multimodal Moment Retrieval10 Jun 2024 0 repositories listed
-
Hybrid-Learning Video Moment Retrieval across Multi-Domain Labels3 Jun 2024 0 repositories listed
-
Context-Enhanced Video Moment Retrieval with Large Language Models21 May 2024 0 repositories listed
-
GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features3 Mar 2024 0 repositories listed
-
Event-aware Video Corpus Moment Retrieval21 Feb 2024 0 repositories listed
Syntology lines on 35 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections