</> Code with Papers by Syntology

Home › Datasets › task › Visual Grounding

Visual Grounding datasets

archive 2025-07-28

11 datasets carry the task tag "Visual Grounding" (the task itself: Visual Grounding), ordered by the archive's paper count. Page 1 of 1: 11 shown of 11. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Visual Grounding 11

Visual Grounding datasets 1–11 of 11

RefCOCO
The RefCOCO dataset is a referring expression generation (REG) dataset used for tasks related to understanding natural language expressions that refer to specific objects in images.
ImagesTextsSemantic SegmentationReferring Expression SegmentationVisual ReasoningReferring Expression ComprehensionVisual GroundingZero-Shot Region Description+1 tasks
439 papers · 11 benchmarks
DIOR-RSVG
DIOR-RSVG is a large-scale benchmark dataset of remote sensing data (RSVG).
ImagesQuestion AnsweringVisual Question Answering (VQA)Image CaptioningRetrievalText RetrievalVisual Grounding
25 papers · 0 benchmarks
MRR-Benchmark (Multi-Modal Reading Benchmark)
Multi-Modal Reading (MMR) Benchmark includes 550 annotated question-answer pairs across 11 distinct tasks involving texts, fonts, visual elements, bounding boxes, spatial relations, and grounding, with carefully designed evaluation metrics.
ImagesTextsOptical Character Recognition (OCR)Font RecognitionVisual GroundingSpatial Relation RecognitionMMR total
11 papers · 1 benchmark
Infinity-MM
We collect, organize and open-source the large-scale multimodal instruction dataset, Infinity-MM, consisting of tens of millions of samples.
ImagesVideosTextsVisual Question Answering (VQA)Optical Character Recognition (OCR)Visual GroundingObject Discovery
5 papers · 0 benchmarks
SkyEye-968k
SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
ImagesTextsVisual Question AnsweringImage CaptioningVideo CaptioningVisual GroundingScene Classification
5 papers · 0 benchmarks
A Game Of Sorts
A Game Of Sorts is a collaborative image ranking task.
ImagesTextsCoreference ResolutionReferring Expression ComprehensionTask-Oriented Dialogue SystemsVisual GroundingReferring expression generationReferring Expression
4 papers · 0 benchmarks
Mono3DRefer
We sample 2025 frames of images from the original KITTI for Mono3DRefer, containing 41,140 expressions in total and a vocabulary of 5,271 words.
ImagesTexts3D3D Object DetectionMonocular 3D Object DetectionVisual GroundingMono3DVG3D visual grounding
3 papers · 0 benchmarks
VizWiz Answer Grounding
Source: paper Visual Question Answering (VQA) is the task of returning the answer to a question about an image.
Visual Grounding
3 papers · 0 benchmarks
SK-VG
SK-VG is a dataset for Scene Knowledge-guided Visual Grounding, where the image content and referring expressions are not sufficient to ground the target objects, forcing the models to have a reasoning ability on the long-form scene…
ImagesVisual Grounding
2 papers · 0 benchmarks
AutomotiveUI-Bench-4K
Dataset Overview: 998 images and 4,208 annotations focusing on interaction with in-vehicle infotainment (IVI) systems.
ImagesTextsVisual GroundingVision-Language-Action
1 paper · 0 benchmarks
VisArgs
VisArgs is a densely annotated benchmark for visual argument understanding.
ImagesTextsVisual GroundingDense Captioning
1 paper · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.