Papers › Video captioning with recurrent networks based on frame- and video-level features and...

Video captioning with recurrent networks based on frame- and video-level features and visual content classification

9 Dec 2015arXiv:1512.02949archive 2025-07-28

Rakshith Shetty, Jorma Laaksonen

In this paper, we describe the system for generating textual descriptions of short video clips using recurrent neural networks (RNN), which we used while participating in the Large Scale Movie Description Challenge 2015 in ICCV 2015. Our work builds on static image captioning systems with RNN based language models and extends this framework to videos utilizing both static image features and video-specific features. In addition, we study the usefulness of visual content classifiers as a source of additional information for caption generation. With experimental results we show that utilizing keyframe based features, dense trajectory video features and content classifier outputs together gives better performance than any one of them individually.

PaperPDFCode

Code

aalto-cbir/neuraltalkTheano officialmentioned in papermentioned on GitHub report
rakshithShetty/captionGAN mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Caption GenerationGeneral ClassificationImage CaptioningVideo Captioning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections