</> Code with Papers by Syntology

Home › Datasets › task › Image-to-Text Retrieval

Image-to-Text Retrieval datasets

archive 2025-07-28

8 datasets carry the task tag "Image-to-Text Retrieval" (the task itself: Image-to-Text Retrieval), ordered by the archive's paper count. Page 1 of 1: 8 shown of 8. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Image-to-Text Retrieval 8

Image-to-Text Retrieval datasets 1–8 of 8

COCO (Common Objects in Context)
The COCO (Common Objects in Context) dataset is a large-scale object detection, segmentation, and captioning dataset.
ImagesVideosObject DetectionSemantic SegmentationQuestion AnsweringPose EstimationVisual Question Answering (VQA)Instance Segmentation+54 tasks
11,922 papers · 77 benchmarks
Flickr30k
The Flickr30k dataset contains 31,000 images collected from Flickr, together with 5 reference sentences provided by human annotators.
ImagesTextsNode ClassificationImage RetrievalImage CaptioningCross-Modal RetrievalImage-to-Text RetrievalPhrase Grounding+5 tasks
880 papers · 9 benchmarks
LAION-400M
LAION-400M is a dataset with CLIP-filtered 400 million image-text pairs, their CLIP embeddings and kNN indices that allow efficient similarity search.
ImagesTextsVideo GenerationImage-to-Text RetrievalSemantic Image-Text Similarity
169 papers · 1 benchmark
RSICD (Remote Sensing Image Captioning Dataset)
ImagesImage CaptioningCross-Modal RetrievalText RetrievalImage-to-Text RetrievalScene Classification
70 papers · 3 benchmarks
XM 3600 (Crossmodal 3600)
Research in massively multilingual image captioning has been severely hampered by a lack of high-quality evaluation datasets.
ImagesTextsImage CaptioningImage-to-Text RetrievalZero-shot Text-to-Image Retrieval
28 papers · 0 benchmarks
WHOOPS!
WHOOPS!
ImagesTextsImage GenerationVisual Question Answering (VQA)Image CaptioningCommon Sense ReasoningImage-to-Text RetrievalVisual Commonsense Reasoning+2 tasks
14 papers · 4 benchmarks
FewSOL (A Dataset for Few-Shot Object Learning in Robotic Environments)
The Few-Shot Object Learning (FewSOL) dataset can be used for object recognition with a few images per object.
ImagesTextsRGB-D6DPose EstimationFew-Shot Image ClassificationFew-Shot LearningFew-Shot Semantic SegmentationObject RecognitionImage-to-Text Retrieval+4 tasks
4 papers · 0 benchmarks
FETA Car-Manuals (FETA Car-Manuals dataset, image-text retrieval for foundation models' expert data performance.)
FETA benchmark focuses on text-to-image and image-to-text retrieval in public car manuals and sales catalogue brochures.
ImagesTextsImage RetrievalImage-to-Text Retrieval
1 paper · 2 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.