Video Summarization

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

16 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 89 papers with code (280 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward
  29 Dec 2017 6 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos.
• Summarizing Videos with Attention
  5 Dec 2018 5 repositories listed Syntology ran 1 of 15 samples · 14 unverified
  In this work we propose a novel method for supervised, keyshots based video summarization by applying a conceptually simple and computationally efficient soft, self-attention mechanism.
• GPT2MVS: Generative Pre-trained Transformer-2 for Multi-modal Video Summarization
  26 Apr 2021 4 repositories listed
  Traditional video summarization methods generate fixed video representations regardless of user interest.
• Supervised Video Summarization via Multiple Feature Sets with Parallel Attention
  23 Apr 2021 3 repositories listed
  The proposed architecture utilizes an attention mechanism before fusing motion features and features representing the (static) visual content, i.
• Unsupervised video summarization framework using keyframe extraction and video skimming
  10 Oct 2019 3 repositories listed
  Video is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years.
• MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
  7 Jun 2023 2 repositories listed
  To address these challenges and provide a comprehensive dataset for this new direction, we have meticulously curated the \textbf{MMSum} dataset.
• Align and Attend: Multimodal Summarization with Dual Contrastive Losses
  13 Mar 2023 2 repositories listed
  The goal of multimodal summarization is to extract the most important information from different modalities to form output summaries.
• Egocentric Video-Language Pretraining
  3 Jun 2022 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  Video-Language Pretraining (VLP), which aims to learn transferable representation to advance a wide range of video-text downstream tasks, has recently received increasing attention.
• Progressive Video Summarization via Multimodal Self-supervised Learning
  7 Jan 2022 2 repositories listed
  Considering that the annotation of large-scale datasets is time-consuming, we propose a multimodal self-supervised learning framework to obtain semantic representations of videos, which benefits the video summarization…
• Video Joint Modelling Based on Hierarchical Transformer for Co-summarization
  27 Dec 2021 2 repositories listed
  Video summarization aims to automatically generate a summary (storyboard or video skim) of a video, which can facilitate large-scale video retrieval and browsing.
• Convolutional Hierarchical Attention Network for Query-Focused Video Summarization
  31 Jan 2020 2 repositories listed
  This paper addresses the task of query-focused video summarization, which takes user's query and a long video as inputs and aims to generate a query-focused video summary.
• Rethinking the Evaluation of Video Summaries
  27 Mar 2019 2 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  Video summarization is a technique to create a short skim of the original video while preserving the main stories/content.
• Iterative Projection and Matching: Finding Structure-preserving Representatives and Its Application to Computer Vision
  29 Nov 2018 2 repositories listed
  In our algorithm, at each iteration, the maximum information from the structure of the data is captured by one selected sample, and the captured information is neglected in the next iterations by projection on the…
• Video Summarization using Deep Semantic Features
  28 Sep 2016 2 repositories listed
  For this, we design a deep neural network that maps videos as well as descriptions to a common semantic space and jointly trained it with associated pairs of videos and descriptions.
• SD-VSum: A Method and Dataset for Script-Driven Video Summarization
  6 May 2025 1 repository listed
  In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the…
• An Egocentric Vision-Language Model based Portable Real-time Smart Assistant
  6 Mar 2025 1 repository listed
  We present Vinci, a vision-language system designed to provide real-time, comprehensive AI assistance on portable devices.
• Integrate the temporal scheme for unsupervised video summarization via attention mechanism
  26 Feb 2025 1 repository listed
  In this work, we present a novel unsupervised scheme named SegSum, designed for video summarization through the creation of video skims.
• What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations
  12 Feb 2025 1 repository listed
  Transforming recorded videos into concise and accurate textual summaries is a growing challenge in multimodal learning.
• Do Language Models Understand Time?
  18 Dec 2024 1 repository listed
  Current approaches to video understanding with LLMs often rely on pretrained video encoders to extract spatiotemporal features and text encoders to capture semantic meaning.
• Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
  12 Dec 2024 1 repository listed Syntology ran 0 of 11 samples · 11 unverified
  The demand for producing short-form videos for sharing on social media platforms has experienced significant growth in recent times.
• Your Interest, Your Summaries: Query-Focused Long Video Summarization
  17 Oct 2024 1 repository listed
  This paper introduces an approach for query-focused video summarization, aiming to align video summaries closely with user queries.
• Does SpatioTemporal information benefit Two video summarization benchmarks?
  4 Oct 2024 1 repository listed
  These models achieved state-of-the-art correlation scores on important benchmark datasets.
• Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding
  22 Sep 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  The VST module is trained by instruction fine-tuning, where two optimizing strategies are offered.
• UBiSS: A Unified Framework for Bimodal Semantic Summarization of Videos
  24 Jun 2024 1 repository listed
  With the surge in the amount of video data, video summarization techniques, including visual-modal(VM) and textual-modal(TM) summarization, are attracting more and more attention.
• A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods
  5 Jun 2024 1 repository listed
  In this paper we introduce a new dataset for 360-degree video summarization: the transformation of 360-degree video content to concise 2D-video summaries that can be consumed via traditional devices, such as TV sets and…
• Shotluck Holmes: A Family of Efficient Small-Scale Large Language Vision Models For Video Captioning and Summarization
  31 May 2024 1 repository listed
  Video is an increasingly prominent and information-dense medium, yet it poses substantial challenges for language models.
• VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
  22 May 2024 1 repository listed Syntology ran 13 of 17 samples · 4 unverified
  Video Temporal Grounding (VTG) strives to accurately pinpoint event timestamps in a specific video using linguistic queries, significantly impacting downstream tasks like video browsing and editing.
• CSTA: CNN-based Spatiotemporal Attention for Video Summarization
  20 May 2024 1 repository listed Syntology ran 7 of 8 samples · 1 unverified
  Video summarization aims to generate a concise representation of a video, capturing its essential content and key moments while reducing its overall length.
• An Integrated Framework for Multi-Granular Explanation of Video Summarization
  16 May 2024 1 repository listed
  The findings of the conducted quantitative and qualitative evaluations demonstrate the ability of our framework to spot the most and least influential fragments and visual objects of the video for the summarizer, and to…
• VideoSAGE: Video Summarization with Graph Representation Learning
  14 Apr 2024 1 repository listed
  We propose a graph-based representation learning framework for video summarization.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.