Browse State-of-the-Art › Spatio-Temporal Video Grounding
Spatio-Temporal Video Grounding
10 papers with code · 3 benchmarks · 3 datasets archive 2025-07-28
Spatio-temporal video grounding is a computer vision and natural language processing (NLP) task that involves linking textual descriptions to specific spatio-temporal regions or moments in a video. In other words, it aims to determine which parts of a video correspond to a given textual query or description. This task is essential for various applications, including video summarization, content-based video retrieval, video captioning, and more.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| HC-STVG2 (4 rows) | TA-STVG | Knowing Your Target: Target-Aware Transformer Makes Better... | code | — | Compare |
| HC-STVG1 (3 rows) | TA-STVG | Knowing Your Target: Target-Aware Transformer Makes Better... | code | — | Compare |
| VidSTG (3 rows) | TA-STVG | Knowing Your Target: Target-Aware Transformer Makes Better... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
3 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 22 · with a code link: 10 · where Syntology ran a sample: 5 (5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 22 tagged: 5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 22 of 22, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
3 Jan 2024 2 repositories listed Syntology official (archive's flag): 15 ran · 22 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 1 violated, 10 with no contract checked; 10 where Syntology's instrument failed) · 12 unverified (of 34 harvested samples) · 34 pointer-only (licence)The key of CG-STVG lies in two specially designed modules, including instance context generation (ICG), which focuses on discovering visual context information (in both appearance and motion) of the instance, and…
-
13 Mar 2025 1 repository listedWe perform extensive ablations that demonstrate the importance of pre-training using our automatically annotated HowToGround1M dataset followed by fine-tuning on the manually annotated iGround dataset and validate the…
-
16 Feb 2025 1 repository listedCompared to existing methods leveraging zero-initialized queries, object queries in our TA-STVG, directly generated from a given video-text pair, naturally carry target-specific cues, making them adaptive and better…
-
22 Nov 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)Extending image-based Large Multimodal Models (LMMs) to videos is challenging due to the inherent complexity of video data.
-
11 Oct 2023 1 repository listedDiverse and extensive work has recently been conducted on text-conditioned human motion generation.
-
29 Mar 2023 1 repository listedSpatio-temporal grounding describes the task of localizing events in space and time, e. g., in video data, based on verbal descriptions only.
-
27 Sep 2022 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 9 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples)Spatio-Temporal video grounding (STVG) focuses on retrieving the spatio-temporal tube of a specific object depicted by a free-form textual expression.
-
30 Mar 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 3 harvested samples)We consider the problem of localizing a spatio-temporal tube in a video corresponding to a given text query.
-
10 Nov 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)HC-STVG is a video grounding task that requires both spatial (where) and temporal (when) localization.
-
19 Jan 2020 1 repository listedIn this paper, we consider a novel task, Spatio-Temporal Video Grounding for Multi-Form Sentences (STVG).
-
SpaceVLLM: Endowing Multimodal Large Language Model with Spatio-Temporal Video Grounding Capability18 Mar 2025 0 repositories listedMultimodal large language models (MLLMs) have made remarkable progress in either temporal or spatial localization.
-
Contextual Self-paced Learning for Weakly Supervised Spatio-Temporal Video Grounding28 Jan 2025 0 repositories listedIn this work, we focus on Weakly Supervised Spatio-Temporal Video Grounding (WSTVG).
-
STPro: Spatial and Temporal Progressive Learning for Weakly Supervised Spatio-Temporal Grounding1 Jan 2025 0 repositories listedIn this work, we study Weakly Supervised Spatio-Temporal Video Grounding (WSTVG), a challenging task of localizing subjects spatio-temporally in videos using only textual queries and no bounding box supervision.
-
VideoGrounding-DINO: Towards Open-Vocabulary Spatio-Temporal Video Grounding1 Jan 2024 0 repositories listedVideo grounding aims to localize a spatio-temporal section in a video corresponding to an input text query.
-
Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Grounding31 Dec 2023 0 repositories listedOur contributions include a novel spatio-temporal video grounding model, surpassing state-of-the-art results in closed-set evaluations on multiple datasets and demonstrating superior performance in open-vocabulary…
-
Collaborative Static and Dynamic Vision-Language Streams for Spatio-Temporal Video Grounding1 Jan 2023 0 repositories listedSpatio-Temporal Video Grounding (STVG) aims to localize the target object spatially and temporally according to the given language query.
-
WINNER: Weakly-Supervised hIerarchical decompositioN and aligNment for Spatio-tEmporal Video gRounding1 Jan 2023 0 repositories listedSpatio-temporal video grounding aims to localize the aligned visual tube corresponding to a language query.
-
6 Jul 2022 0 repositories listedIn this technical report, we introduce our solution to human-centric spatio-temporal video grounding task.
-
Gaussian Kernel-based Cross Modal Network for Spatio-Temporal Video Grounding2 Jul 2022 0 repositories listedSpatial-Temporal Video Grounding (STVG) is a challenging task which aims to localize the spatio-temporal tube of the interested object semantically according to a natural language query.
-
Augmented 2D-TAN: A Two-stage Approach for Human-centric Spatio-Temporal Video Grounding20 Jun 2021 0 repositories listedWe propose an effective two-stage approach to tackle the problem of language-based Human-centric Spatio-Temporal Video Grounding (HC-STVG) task.
-
STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding1 Jan 2021 0 repositories listedSpatio-temporal video grounding (STVG) aims to localize a spatio-temporal tube of a target object in an untrimmed video based on a query sentence.
-
Object-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Grounding16 Aug 2020 0 repositories listedSpatio-temporal video grounding aims to retrieve the spatio-temporal tube of a queried object according to the given sentence.
Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections