Papers › Show and Tell: A Neural Image Caption Generator
Show and Tell: A Neural Image Caption Generator
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan
Automatically describing the content of an image is a fundamental problem in artificial intelligence that connects computer vision and natural language processing. In this paper, we present a generative model based on a deep recurrent architecture that combines recent advances in computer vision and machine translation and that can be used to generate natural sentences describing an image. The model is trained to maximize the likelihood of the target description sentence given the training image. Experiments on several datasets show the accuracy of the model and the fluency of the language it learns solely from image descriptions. Our model is often quite accurate, which we verify both qualitatively and quantitatively. For instance, while the current state-of-the-art BLEU-1 score (the higher the better) on the Pascal dataset is 25, our approach yields 59, to be compared to human performance around 69. We also show BLEU-1 score improvements on Flickr30k, from 56 to 66, and on SBU, from 19 to 28. Lastly, on the newly released COCO dataset, we achieve a BLEU-4 of 27.7, which is the current state-of-the-art.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1411.4555")
Code
Syntology Ran 13 of 34 code samples harvested from 14 repositories linked to this paper; 21 have no recorded run. Of those that ran: 2 ran · honoured contract; 2 ran · violated contract; 8 ran · our draft was wrong; 1 ran with no contract checked.
By repository: community (archive-listed): 34 samples from 14 repositories, 13 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.
74 repositories listed; official and paper-mentioned ones first.
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
34 samples harvested; 13 ran; 2 honoured the contract we drafted; 21 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.
Licence: 6 of the 34 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.
Harvested from 14 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.
Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.
Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.
6fa2f3770918589b · report
84ee72bc513b03f8 · report
1332e67cdbc4c88a · report
9a121ed8c3d15bc5 · report
1a9ae5954fd68227 · report
940455900b9ee75f · report
d546eb3f62e6ef39 · report
30b6ac17db0d1ce6 · report
ec4448373d72d636 · report
d6f73a39ee4c2493 · report
9bfeeae84da4c830 · report
d3ef7591e1d22a18 · report
dd99f91353354ec4 · report
e8ee54a0610e9634 · report
d3feb7c8293a8cfd · report
3b20293ce047ab05 · report
f1bf9ccad2d63845 · report
57c560e03a5007e8 · report
49c5d3755926b6ef · report
ed75cf97c296beab · report
d0b88657ee87ce95 · report
e222ea9e1518266f · report
12f6cbc65ecc5156 · report
c53c0bb2023ac902 · report
d7eeb3c0e4ec601d · report
e29bef7d2cee141a · report
c1df9623c188caff · report
043f5555303ee47e · report
e9aaa80e5a2ae620 · report
73cfd8350786c342 · report
ddccddb3e642d270 · report
020c3cce307058ec · report
bb0b8cedb4bac982 · report
e803ca67568776c1 · report
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Image Retrieval with Multi-Modal Query | Fashion200k | Show and Tell | Recall@1 | 12.3 | #6 of 8 | Archive leaderboard | report |
| Image Retrieval with Multi-Modal Query | Fashion200k | Show and Tell | Recall@10 | 40.2 | #6 of 8 | Archive leaderboard | report |
| Image Retrieval with Multi-Modal Query | Fashion200k | Show and Tell | Recall@50 | 61.8 | #6 of 8 | Archive leaderboard | report |
| Image Retrieval with Multi-Modal Query | MIT-States | Show and Tell | Recall@1 | 11.9 | #3 of 5 | Archive leaderboard | report |
| Image Retrieval with Multi-Modal Query | MIT-States | Show and Tell | Recall@10 | 42.0 | #3 of 5 | Archive leaderboard | report |
| Image Retrieval with Multi-Modal Query | MIT-States | Show and Tell | Recall@5 | 31.0 | #3 of 5 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections