</> Code with Papers by Syntology

Home › Datasets › task › Video Grounding

Video Grounding datasets

archive 2025-07-28

10 datasets carry the task tag "Video Grounding" (the task itself: Video Grounding), ordered by the archive's paper count. Page 1 of 1: 10 shown of 10. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Video Grounding 10

Video Grounding datasets 1–10 of 10

Kinetics (Kinetics Human Action Video Dataset)
The Kinetics dataset is a large-scale, high-quality dataset for human action recognition in videos.
VideosAction RecognitionTemporal Action LocalizationImage ClusteringSkeleton Based Action RecognitionVideo RetrievalAction Classification+24 tasks
1,341 papers · 18 benchmarks
QVHighlights (Query-based Video Highlights)
The Query-based Video Highlights (QVHighlights) dataset is a dataset for detecting customized moments and highlights from videos given natural language (NL).
VideosTextsHighlight DetectionMoment RetrievalVideo GroundingZero-shot Moment Retrieval
41 papers · 4 benchmarks
MAD
MAD (Movie Audio Descriptions) is an automatically curated large-scale dataset for the task of natural language grounding in videos or natural language moment retrieval.
VideosTextsNatural Language Moment RetrievalMoment RetrievalVideo GroundingNatural Language Visual Grounding
36 papers · 2 benchmarks
Animal Kingdom
Animal Kingdom is a large and diverse dataset that provides multiple annotated tasks to enable a more thorough understanding of natural animal behaviors.
ImagesVideosPose EstimationAction RecognitionLong-tail Learning2D Pose EstimationAnimal Pose EstimationVideo Grounding+2 tasks
26 papers · 2 benchmarks
STAR Benchmark (Situated Reasoning)
How to capture the present knowledge from surrounding situations and perform reasoning accordingly is crucial and challenging for machine intelligence.
VideosTextsVideo Question AnsweringVideo UnderstandingZero-Shot Video Question AnswerVideo GroundingVideo scene graph generation
17 papers · 2 benchmarks
DTTD-Mobile
Are current 3D object tracking methods truely robust enough for low-fidelity depth sensors like the iPhone LiDAR?
ImagesVideos3DObject DetectionSemantic Segmentation2D Semantic Segmentation3D Object DetectionDepth EstimationMulti-Object Tracking+13 tasks
8 papers · 2 benchmarks
LongVALE
Despite impressive advancements in video understanding, most efforts remain limited to coarse-grained or visual-only video tasks.
VideosTextsAudioSpeechVideo CaptioningDense Video CaptioningAudio captioningNatural Language Moment RetrievalMoment RetrievalVideo Grounding+3 tasks
2 papers · 0 benchmarks
Kinetics-GEB+
Kinetics-GEB+ (Generic Event Boundary Captioning, Grounding and Retrieval) is a dataset that consists of over 170k boundaries associated with captions describing status changes in the generic events in 12K videos.
VideosVideo RetrievalVideo UnderstandingVideo CaptioningText to Video RetrievalVideo GroundingBoundary Captioning+1 tasks
1 paper · 3 benchmarks
YouwikiHow
YouwikiHow is a dataset for Weakly-Supervised temporal Article Grounding (WSAG).
VideosTextsVideo GroundingNatural Language Queries
1 paper · 0 benchmarks
Vript (🎬 Vript: A Video Is Worth Thousands of Words)
We construct a fine-grained video-text dataset with 12K annotated high-resolution videos (~400k clips).
VideosTextsVideo Question AnsweringVideo UnderstandingVideo CaptioningText-to-Image GenerationDense Video CaptioningText-to-Video Generation+1 tasks
0 papers · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.