Papers › Unsupervised Video Summarization via Attention-Driven Adversarial Learning
Unsupervised Video Summarization via Attention-Driven Adversarial Learning
Evlampios Apostolidis, Eleni Adamantidou, Alexandros I. Metsai, Vasileios Mezaris, Ioannis Patras
This paper presents a new video summarization approach that integrates an attention mechanism to identify the significant parts of the video, and is trained unsupervisingly via generative adversarial learning. Starting from the SUM-GAN model, we first develop an improved version of it (called SUM-GAN-sl) that has a significantly reduced number of learned parameters, performs incremental training of the model’s components, and applies a stepwise label-based strategy for updating the adversarial part. Subsequently, we introduce an attention mechanism to SUM-GAN-sl in two ways: (i) by integrating an attention layer within the variational auto-encoder (VAE) of the architecture (SUM-GAN-VAAE), and (ii) by replacing the VAE with a deterministic attention auto-encoder (SUM-GAN-AAE). Experimental evaluation on two datasets (SumMe and TVSum) documents the contribution of the attention auto-encoder to faster and more stable training of the model, resulting in a significant performance improvement with respect to the original model and demonstrating the competitiveness of the proposed SUM-GAN-AAE against the state of the art.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Unsupervised Video Summarization | SumMe | SUM-GAN-AAE | F1-score | 48.9 | #7 of 10 | Archive leaderboard | report |
| Unsupervised Video Summarization | SumMe | SUM-GAN-AAE | Parameters (M) | 24.31 | #7 of 10 | Archive leaderboard | report |
| Unsupervised Video Summarization | SumMe | SUM-GAN-AAE | training time (s) | 1639 | #7 of 10 | Archive leaderboard | report |
| Unsupervised Video Summarization | TvSum | SUM-GAN-AAE | F1-score | 58.3 | #6 of 8 | Archive leaderboard | report |
| Unsupervised Video Summarization | TvSum | SUM-GAN-AAE | Parameters (M) | 24.31 | #6 of 8 | Archive leaderboard | report |
| Unsupervised Video Summarization | TvSum | SUM-GAN-AAE | training time (s) | 5423 | #6 of 8 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections