Papers › AC-SUM-GAN: Connecting Actor-Critic and Generative Adversarial Networks for...

AC-SUM-GAN: Connecting Actor-Critic and Generative Adversarial Networks for Unsupervised Video Summarization

16 Nov 2020IEEE Transactions on Circuits and Systems for Video Technology 2020 11archive 2025-07-28

Evlampios Apostolidis, Eleni Adamantidou, Alexandros I. Metsai, Vasileios Mezaris, Ioannis Patras

This paper presents a new method for unsupervised video summarization. The proposed architecture embeds an Actor-Critic model into a Generative Adversarial Network and formulates the selection of important video fragments (that will be used to form the summary) as a sequence generation task. The Actor and the Critic take part in a game that incrementally leads to the selection of the video key-fragments, and their choices at each step of the game result in a set of rewards from the Discriminator. The designed training workflow allows the Actor and Critic to discover a space of actions and automatically learn a policy for key-fragment selection. Moreover, the introduced criterion for choosing the best model after the training ends, enables the automatic selection of proper values for parameters of the training process that are not learned from the data (such as the regularization factor σ). Experimental evaluation on two benchmark datasets (SumMe and TVSum) demonstrates that the proposed AC-SUM-GAN model performs consistently well and gives SoA results in comparison to unsupervised methods, that are also competitive with respect to supervised methods.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Unsupervised Video SummarizationVideo Summarization

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Video Summarization SumMe AC-SUM-GAN F1-score 50.8 #6 of 10 Archive leaderboard report
Unsupervised Video Summarization SumMe AC-SUM-GAN Parameters (M) 26.75 #6 of 10 Archive leaderboard report
Unsupervised Video Summarization SumMe AC-SUM-GAN training time (s) 2825 #6 of 10 Archive leaderboard report
Unsupervised Video Summarization TvSum AC-SUM-GAN F1-score 60.6 #3 of 8 Archive leaderboard report
Unsupervised Video Summarization TvSum AC-SUM-GAN Parameters (M) 26.75 #3 of 8 Archive leaderboard report
Unsupervised Video Summarization TvSum AC-SUM-GAN training time (s) 9380 #3 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections