Caption Generation

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 119 papers with code (310 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
  10 Feb 2015 92 repositories listed Syntology ran 15 of 84 samples · 69 unverified · 7 pointer-only (licence)
  Inspired by recent work in machine translation and object detection, we introduce an attention based model that automatically learns to describe the content of images.
• Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
  30 Oct 2017 24 repositories listed Syntology ran 4 of 7 samples · 3 unverified · 3 pointer-only (licence)
  Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems.
• Recurrent Neural Network Regularization
  8 Sep 2014 21 repositories listed Syntology ran 2 of 6 samples · 4 unverified · 6 pointer-only (licence)
  We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units.
• Microsoft COCO Captions: Data Collection and Evaluation Server
  1 Apr 2015 18 repositories listed
  In this paper we describe the Microsoft COCO Caption dataset and evaluation server.
• Where to put the Image in an Image Caption Generator
  27 Mar 2017 12 repositories listed
  When a recurrent neural network language model is used for caption generation, the image information can be fed to the neural network either by directly incorporating it in the RNN -- conditioning the language model by…
• Sequence to Sequence -- Video to Text
  3 May 2015 4 repositories listed
  Our LSTM model is trained on video-sentence pairs and learns to associate a sequence of video frames to a sequence of words in order to generate a description of the event in the video clip.
• Scalable Bayesian Optimization Using Deep Neural Networks
  19 Feb 2015 4 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations.
• Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning
  22 Aug 2023 3 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  To fill this gap, we present a methodology for generating question-answer pairs from existing audio captioning datasets and introduce the MusicQA Dataset designed for answering open-ended music-related questions.
• Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
  17 Feb 2021 3 repositories listed
  The availability of large-scale image captioning and visual question answering datasets has contributed significantly to recent successes in vision-and-language pre-training.
• Deep Reinforcement Learning For Sequence to Sequence Models
  24 May 2018 3 repositories listed Syntology ran 3 of 17 samples · 14 unverified
  In this survey, we consider seq2seq problems from the RL point of view and provide a formulation combining the power of RL methods in decision-making with sequence-to-sequence models that enable remembering long-term…
• An Actor-Critic Algorithm for Sequence Prediction
  24 Jul 2016 3 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We present an approach to training neural networks to generate sequences using actor-critic methods from reinforcement learning (RL).
• ViPE: Visualise Pretty-much Everything
  16 Oct 2023 2 repositories listed Syntology ran 6 of 6 samples · 0 unverified
  Figurative and non-literal expressions are profoundly integrated in human communication.
• Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  2 Jan 2023 2 repositories listed
  Experiments on the COCO dataset with two settings: Open Vocabulary Instance Segmentation (OVIS) and Open Set Panoptic Segmentation (OSPS) demonstrate the superiority of the CGG.
• COSMic: A Coherence-Aware Generation Metric for Image Descriptions
  11 Sep 2021 2 repositories listed
  Developers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations.
• End-to-End Dense Video Captioning with Parallel Decoding
  17 Aug 2021 2 repositories listed Syntology ran 3 of 7 samples · 4 unverified
  Dense video captioning aims to generate multiple associated captions with their temporal locations from the video.
• Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement
  19 Feb 2018 2 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 1 pointer-only (licence)
  We propose a conditional non-autoregressive neural sequence model based on iterative refinement.
• Exploring Models and Data for Remote Sensing Image Caption Generation
  21 Dec 2017 2 repositories listed
  Finally, a comprehensive review is presented on the proposed data set to fully advance the task of remote sensing caption.
• Attacking Visual Language Grounding with Adversarial Examples: A Case Study on Neural Image Captioning
  6 Dec 2017 2 repositories listed
  Our extensive experiments show that our algorithm can successfully craft visually-similar adversarial examples with randomly targeted captions or keywords, and the adversarial examples can be made highly transferable to…
• Tensor Product Generation Networks for Deep NLP Modeling
  26 Sep 2017 2 repositories listed
  We present a new approach to the design of deep networks for natural language processing (NLP), based on the general technique of Tensor Product Representations (TPRs) for encoding and processing symbol structures in…
• Twin Networks: Matching the Future for Sequence Generation
  22 Aug 2017 2 repositories listed
  We propose a simple technique for encouraging generative RNNs to plan ahead.
• CNN Fixations: An unraveling approach to visualize the discriminative image regions
  22 Aug 2017 2 repositories listed
  We demonstrate through a variety of applications that our approach is able to localize the discriminative image locations across different network architectures, diverse vision tasks and data modalities.
• An Empirical Study of Language CNN for Image Captioning
  21 Dec 2016 2 repositories listed
  Language Models based on recurrent neural networks have dominated recent image caption generation tasks.
• DSD: Dense-Sparse-Dense Training for Deep Neural Networks
  15 Jul 2016 2 repositories listed
  We propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance.
• Video captioning with recurrent networks based on frame- and video-level features and visual content classification
  9 Dec 2015 2 repositories listed
  In this paper, we describe the system for generating textual descriptions of short video clips using recurrent neural networks (RNN), which we used while participating in the Large Scale Movie Description Challenge 2015…
• DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World
  30 Jun 2025 1 repository listed
  Extensive experiments on various settings, including vision-language understanding, visual grounding, and region caption generation, demonstrate the effectiveness of our DenseWorld-1M dataset and labeling models.
• SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
  18 Jun 2025 1 repository listed
  Detailed captions that accurately reflect the characteristics of a music piece can enrich music databases and drive forward research in music AI.
• FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion
  1 Jun 2025 1 repository listed
  High-quality, large-scale audio captioning is crucial for advancing audio understanding, yet current automated methods often generate captions that lack fine-grained detail and contextual accuracy, primarily due to…
• VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluation
  29 May 2025 1 repository listed
  Video captions play a crucial role in text-to-video generation tasks, as their quality directly influences the semantic coherence and visual fidelity of the generated videos.
• LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
  20 May 2025 1 repository listed
  To address these limitations, we introduce LoVR, a benchmark specifically designed for long video-text retrieval.
• VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
  25 Apr 2025 1 repository listed
  Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content.

Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.