Dense Video Captioning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

9 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 39 papers with code (76 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Multi-modal Dense Video Captioning
  17 Mar 2020 4 repositories listed
  We apply automatic speech recognition (ASR) system to obtain a temporally aligned textual description of the speech (similar to subtitles) and treat it as a separate input alongside video frames and the corresponding…
• Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
  27 Feb 2023 3 repositories listed
  In this work, we introduce Vid2Seq, a multi-modal single-stage dense event captioning model pretrained on narrated videos which are readily-available at scale.
• SoccerNet 2023 Challenges Results
  12 Sep 2023 2 repositories listed
  More information on the tasks, challenges, and leaderboards are available on https://www.
• SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentaries
  10 Apr 2023 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  By providing broadcasters with a tool to summarize the content of their video with the same level of engagement as a live game, our method could help satisfy the needs of the numerous fans who follow their team but…
• End-to-End Dense Video Captioning with Parallel Decoding
  17 Aug 2021 2 repositories listed Syntology ran 3 of 7 samples · 4 unverified
  Dense video captioning aims to generate multiple associated captions with their temporal locations from the video.
• A Better Use of Audio-Visual Cues: Dense Video Captioning with Bi-modal Transformer
  17 May 2020 2 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  We show the effectiveness of the proposed model with audio and visual modalities on the dense video captioning task, yet the module is capable of digesting any two modalities in a sequence-to-sequence task.
• VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
  12 Jan 2025 1 repository listed
  Despite the advancements of Video Large Language Models (VideoLLMs) in various tasks, they struggle with fine-grained temporal understanding, such as Dense Video Captioning (DVC).
• HiCM²: Hierarchical Compact Memory Modeling for Dense Video Captioning
  19 Dec 2024 1 repository listed
  With the growing demand for solutions to real-world video challenges, interest in dense video captioning (DVC) has been on the rise.
• Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning
  17 Dec 2024 1 repository listed Syntology ran 0 of 12 samples · 12 unverified
  Existing methods rely on explicit alignment constraints between event locations and captions, which involve complex event proposal procedures during both training and inference.
• LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
  29 Nov 2024 1 repository listed Syntology ran 2 of 12 samples · 10 unverified
  Despite impressive advancements in video understanding, most efforts remain limited to coarse-grained or visual-only video tasks.
• VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format
  27 Nov 2024 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  We construct MMDuetIT, a video-text training dataset designed to adapt VideoLLMs to video-text duet interaction format.
• Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  4 Oct 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Video Large Language Models (Video-LLMs) have demonstrated remarkable capabilities in coarse-grained video understanding, however, they struggle with fine-grained temporal grounding.
• SoccerNet 2024 Challenges Results
  16 Sep 2024 1 repository listed
  The SoccerNet 2024 challenges represent the fourth annual video understanding challenges organized by the SoccerNet team.
• COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark
  5 Aug 2024 1 repository listed
  With this setup, we collected a diverse dataset by distributing smartphones to participants.
• Live Video Captioning
  20 Jun 2024 1 repository listed
  In this work we formally introduce the novel problem of LVC and propose new evaluation metrics tailored for the online scenario, demonstrating their superiority over traditional metrics.
• VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
  13 Jun 2024 1 repository listed Syntology ran 6 of 8 samples · 2 unverified · 8 pointer-only (licence)
  Building on the advances of language models, Large Multimodal Models (LMMs) have contributed significant improvements in video understanding.
• VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
  22 May 2024 1 repository listed Syntology ran 13 of 17 samples · 4 unverified
  Video Temporal Grounding (VTG) strives to accurately pinpoint event timestamps in a specific video using linguistic queries, significantly impacting downstream tasks like video browsing and editing.
• TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning
  14 Apr 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Traffic video description and analysis have received much attention recently due to the growing demand for efficient and reliable urban surveillance systems.
• Enhancing Traffic Safety with Parallel Dense Video Captioning for End-to-End Event Analysis
  12 Apr 2024 1 repository listed
  Our solution mainly focuses on the following points: 1) To solve dense video captioning, we leverage the framework of dense video captioning with parallel decoding (PDVC) to model visual-language sequences and generate…
• Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
  11 Apr 2024 1 repository listed Syntology ran 2 of 3 samples · 1 unverified
  There has been significant attention to the research on dense video captioning, which aims to automatically localize and caption all events within untrimmed video.
• Streaming Dense Video Captioning
  1 Apr 2024 1 repository listed
  An ideal model for dense video captioning -- predicting captions localized temporally in a video -- should be able to handle long input videos, predict rich, detailed textual descriptions, and be able to produce outputs…
• OmniVid: A Generative Framework for Universal Video Understanding
  26 Mar 2024 1 repository listed Syntology ran 3 of 11 samples · 8 unverified · 11 pointer-only (licence)
  The core of video understanding tasks, such as recognition, captioning, and tracking, is to automatically detect objects or actions in a video and analyze their temporal evolution.
• VTimeLLM: Empower LLM to Grasp Video Moments
  30 Nov 2023 1 repository listed Syntology ran 5 of 11 samples · 6 unverified · 11 pointer-only (licence)
  Large language models (LLMs) have shown remarkable text understanding capabilities, which have been extended as Video LLMs to handle video data for comprehending visual details.
• VidChapters-7M: Video Chapters at Scale
  25 Sep 2023 1 repository listed Syntology ran 0 of 9 samples · 9 unverified
  To address this issue, we present VidChapters-7M, a dataset of 817K user-chaptered videos including 7M chapters in total.
• Visual Transformation Telling
  3 May 2023 1 repository listed
  Humans can naturally reason from superficial state differences (e.
• Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
  11 Mar 2023 1 repository listed Syntology ran 1 of 12 samples · 11 unverified
  Our framework is easily extensible to tasks covering visually-grounded language understanding and generation.
• Event and Entity Extraction from Generated Video Captions
  5 Nov 2022 1 repository listed
  Our experiments show that it is possible to extract entities, their properties, relations between entities, and the video category from the generated captions.
• Unifying Event Detection and Captioning as Sequence Generation via Pre-Training
  18 Jul 2022 1 repository listed Syntology ran 7 of 13 samples · 6 unverified · 13 pointer-only (licence)
  Dense video captioning aims to generate corresponding text descriptions for a series of events in the untrimmed video, which can be divided into two sub-tasks, event detection and event captioning.
• Dense Video Captioning Using Unsupervised Semantic Information
  15 Dec 2021 1 repository listed
  We introduce a method to learn unsupervised semantic visual information based on the premise that complex events can be decomposed into simpler events and that these simple events are shared across several complex…
• Global Object Proposals for Improving Multi-Sentence Video Descriptions
  18 Jul 2021 1 repository listed
  Recently, many works are proposed on the generation of multi-sentence video descriptions.

Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.