Home › Datasets › task › Video Summarization
Video Summarization datasets
archive 2025-07-28
16 datasets carry the task tag "Video Summarization" (the task itself: Video Summarization), ordered by the archive's paper count. Page 1 of 1: 16 shown of 16. Facet routes are this site's own (the archive records the tag string, not a page).
The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.
Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets
Video Summarization datasets 1–16 of 16
The SumMe dataset is a video summarization dataset consisting of 25 videos, each annotated with at least 15 human summaries (390 in total).
146 papers · 3 benchmarks
TvSum (TVSum: Summarizing Web Videos Using Titles)
Introduced by Song et al.
28 papers · 4 benchmarks
HyperKvasir dataset contains 110,079 images and 374 videos where it captures anatomical landmarks and pathological and normal findings.
12 papers · 2 benchmarks
The Video2GIF dataset contains over 100,000 pairs of GIFs and their source videos.
11 papers · 0 benchmarks
VideoXum is an enriched large-scale dataset for cross-modal video summarization.
8 papers · 1 benchmark
Collects dense per-video-shot concept annotations.
4 papers · 1 benchmark
Contains 140 videos with multiple human created summaries, which were acquired in a controlled experiment.
4 papers · 0 benchmarks
Ego4D-HCap is a hierarchical video captioning dataset comprised of a three-tier hierarchy of captions: short clip-level captions, medium-length video segment descriptions, and long-range video-level summaries.
3 papers · 0 benchmarks
A short clip of video may contain progression of multiple events and an interesting story line.
3 papers · 3 benchmarks
RAD (RELEVANCE AND DIVERSITY DATASET)
The dataset is useful for query-adaptive video summarization and annotated with diversity and query-specific relevance labels.
2 papers · 0 benchmarks
Contains about 1, 000 videos from 10 queries and their video tags, manual annotations, and associated web images.
1 paper · 0 benchmarks
A new multi-view egocentric dataset, Multi-Ego.
1 paper · 0 benchmarks
MultiSum is a dataset for multimodal summarization (MSMO).
1 paper · 0 benchmarks
OSTD (Open-Source-Total-Distance)
This dataset consists of 18 movies with duration range between 10 and 104 minutes leveraged from the OVSD dataset (Rotman et al., 2016).
1 paper · 0 benchmarks
SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset.
1 paper · 0 benchmarks
Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.