Video Grounding

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

10 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 56 papers with code (114 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection
  23 Mar 2022 3 repositories listed
  Finding relevant moments and highlights in videos according to natural language queries is a natural and highly valuable common need in the current video content explosion era.
• InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
  22 Mar 2024 2 repositories listed
  We introduce InternVideo2, a new family of video foundation models (ViFM) that achieve the state-of-the-art results in video recognition, video-text tasks, and video-centric dialogue.
• Context-Guided Spatio-Temporal Video Grounding
  3 Jan 2024 2 repositories listed Syntology ran 21 of 34 samples · 13 unverified · 34 pointer-only (licence)
  The key of CG-STVG lies in two specially designed modules, including instance context generation (ICG), which focuses on discovering visual context information (in both appearance and motion) of the instance, and…
• Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding
  10 Sep 2021 2 repositories listed
  Instead, from a perspective on temporal grounding as a metric-learning problem, we present a Mutual Matching Network (MMN), to directly model the similarity between language queries and video moments in a joint…
• Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  2 Jun 2025 1 repository listed Syntology ran 2 of 17 samples · 15 unverified
  In this work, we explore RLT as a post-training strategy to enhance the video-specific reasoning capabilities of MLLMs.
• DeCafNet: Delegate and Conquer for Efficient Temporal Grounding in Long Videos
  22 May 2025 1 repository listed
  The approach taken by existing methods of dividing video into clips and processing each clip via a full-scale expert encoder is challenging to scale due to prohibitive computational costs of processing a large number of…
• Object-Shot Enhanced Grounding Network for Egocentric Video
  7 May 2025 1 repository listed Syntology ran 4 of 17 samples · 13 unverified
  To address these limitations, we propose OSGNet, an Object-Shot enhanced Grounding Network for egocentric video.
• TimeZero: Temporal Video Grounding with Reasoning-Guided LVLM
  17 Mar 2025 1 repository listed Syntology ran 0 of 7 samples · 7 unverified
  We introduce TimeZero, a reasoning-guided LVLM designed for the temporal video grounding (TVG) task.
• OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding
  13 Mar 2025 1 repository listed
  Each sequence in BOSTVG, paired with a free-form textual query, encompasses a varying number of targets ranging from 1 to 10.
• TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long Videos
  9 Mar 2025 1 repository listed
  Temporal localization in untrimmed videos, which aims to identify specific timestamps, is crucial for video understanding but remains challenging.
• Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding
  16 Feb 2025 1 repository listed
  Compared to existing methods leveraging zero-initialized queries, object queries in our TA-STVG, directly generated from a given video-text pair, naturally carry target-specific cues, making them adaptive and better…
• Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understanding
  14 Jan 2025 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  We introduce Tarsier2, a state-of-the-art large vision-language model (LVLM) designed for generating detailed and accurate video descriptions, while also exhibiting superior general video understanding capabilities.
• LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
  14 Jan 2025 1 repository listed Syntology ran 3 of 7 samples · 4 unverified
  Furthermore, we propose ST-Align dataset with 4.
• VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
  12 Jan 2025 1 repository listed
  Despite the advancements of Video Large Language Models (VideoLLMs) in various tasks, they struggle with fine-grained temporal understanding, such as Dense Video Captioning (DVC).
• Consistency of Compositional Generalization across Multiple Levels
  18 Dec 2024 1 repository listed
  Compositional generalization is the capability of a model to understand novel compositions composed of seen concepts.
• VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format
  27 Nov 2024 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  We construct MMDuetIT, a video-text training dataset designed to adapt VideoLLMs to video-text duet interaction format.
• Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval
  21 Jul 2024 1 repository listed Syntology ran 5 of 11 samples · 6 unverified
  Through a feasibility study, we demonstrate that LLM encoders effectively refine inter-concept relations in multimodal embeddings, even without being trained on textual embeddings.
• Artemis: Towards Referential Understanding in Complex Videos
  1 Jun 2024 1 repository listed
  Videos carry rich visual information including object description, action, interaction, etc., but the existing multimodal large language models (MLLMs) fell short in referential understanding scenarios such as…
• SnAG: Scalable and Accurate Video Grounding
  2 Apr 2024 1 repository listed Syntology ran 5 of 20 samples · 15 unverified · 5 pointer-only (licence)
  In this paper, we study the effect of cross-modal fusion on the scalability of video grounding models.
• Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Grounding
  21 Mar 2024 1 repository listed
  Inspired by the activity-silent and persistent activity mechanisms in human visual perception biology, we design a Unified Static and Dynamic Network (UniSDNet), to learn the semantic association between the video and…
• HawkEye: Training Video-Text LLMs for Grounding Text in Videos
  15 Mar 2024 1 repository listed Syntology ran 6 of 6 samples · 0 unverified · 6 pointer-only (licence)
  Video-text Large Language Models (video-text LLMs) have shown remarkable performance in answering questions and holding conversations on simple videos.
• Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding
  27 Dec 2023 1 repository listed
  In the weakly supervised temporal video grounding study, previous methods use predetermined single Gaussian proposals which lack the ability to express diverse events described by the sentence query.
• Cross-modal Contrastive Learning with Asymmetric Co-attention Network for Video Moment Retrieval
  12 Dec 2023 1 repository listed
  Video moment retrieval is a challenging task requiring fine-grained interactions between video and text modalities.
• Grounded Question-Answering in Long Egocentric Videos
  11 Dec 2023 1 repository listed Syntology ran 5 of 6 samples · 1 unverified
  Existing approaches to video understanding, mainly designed for short videos from a third-person perspective, are limited in their applicability in certain fields, such as robotics.
• VTimeLLM: Empower LLM to Grasp Video Moments
  30 Nov 2023 1 repository listed Syntology ran 5 of 11 samples · 6 unverified · 11 pointer-only (licence)
  Large language models (LLMs) have shown remarkable text understanding capabilities, which have been extended as Video LLMs to handle video data for comprehending visual details.
• Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection
  28 Nov 2023 1 repository listed Syntology ran 9 of 12 samples · 3 unverified
  Video Moment Retrieval (MR) and Highlight Detection (HD) have attracted significant attention due to the growing demand for video analysis.
• PG-Video-LLaVA: Pixel Grounding Large Video-Language Models
  22 Nov 2023 1 repository listed Syntology ran 1 of 5 samples · 4 unverified · 5 pointer-only (licence)
  Extending image-based Large Multimodal Models (LMMs) to videos is challenging due to the inherent complexity of video data.
• Exploring Iterative Refinement with Diffusion Models for Video Grounding
  26 Oct 2023 1 repository listed
  In this paper, we propose DiffusionVG, a novel framework with diffusion models that formulates video grounding as a conditional generation task, where the target span is generated from Gaussian noise inputs and…
• Dual-Path Temporal Map Optimization for Make-up Temporal Video Grounding
  12 Sep 2023 1 repository listed
  Compared with the general video grounding task, MTVG focuses on meticulous actions and changes on the face.
• Can I Trust Your Answer? Visually Grounded Video Question Answering
  4 Sep 2023 1 repository listed Syntology ran 5 of 7 samples · 2 unverified
  We study visually grounded VideoQA in response to the emerging trends of utilizing pretraining techniques for video-language understanding.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.