Home › Datasets › task › Action Detection
Action Detection datasets
archive 2025-07-2834 datasets carry the task tag "Action Detection" (the task itself: Action Detection), ordered by the archive's paper count. Page 1 of 1: 34 shown of 34. Facet routes are this site's own (the archive records the tag string, not a page).
The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.
Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets
All 12,172
Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Action Detection 34
Action Detection datasets 1–34 of 34
The ActivityNet dataset contains 200 different types of activities and a total of 849 hours of videos collected from YouTube.
807 papers · 17 benchmarks
The Charades dataset is composed of 9,848 videos of daily indoors activities with an average length of 30 seconds, involving interactions with 46 objects classes in 15 types of indoor scenes and containing a vocabulary of 30 verbs leading…
428 papers · 6 benchmarks
The THUMOS14 (THUMOS 2014) dataset is a large-scale video dataset that includes 1,010 videos for validation and 1,574 videos for testing from 20 classes.
318 papers · 18 benchmarks
JHMDB (Joint-annotated Human Motion Data Base)
JHMDB is an action recognition dataset that consists of 960 video sequences belonging to 21 actions.
249 papers · 9 benchmarks
AVA (Atomic Visual Actions)
AVA is a project that provides audiovisual annotations of video for improving our understanding of human activity.
113 papers · 7 benchmarks
The MultiTHUMOS dataset contains dense, multilabel, frame-level action annotations for 30 hours across 400 videos in the THUMOS'14 action detection dataset.
58 papers · 3 benchmarks
A large scale dataset with daily-living activities performed in a natural manner.
31 papers · 1 benchmark
A realistic dataset composed of 27 episodes from 6 popular TV series.
29 papers · 1 benchmark
ROAD (ROAD: The ROad event Awareness Dataset for Autonomous Driving)
ROAD is designed to test an autonomous vehicle's ability to detect road events, defined as triplets composed by an active agent, the action(s) it performs and the corresponding scene locations.
27 papers · 0 benchmarks
A new video dataset for aerial view concurrent human action detection.
24 papers · 1 benchmark
Spatio-temporal action detection is an important and challenging problem in video understanding.
20 papers · 2 benchmarks
MEVA (Multiview Extended Video with Activities)
Large-scale dataset for human activity recognition.
17 papers · 0 benchmarks
Click to add a brief description of the dataset (Markdown and LaTeX enabled).
17 papers · 3 benchmarks
TSU (Toyota Smarthome Untrimmed)
Toyota Smarthome Untrimmed (TSU) is a dataset for activity detection in long untrimmed videos.
16 papers · 1 benchmark
Contains densely labeled speech activity in YouTube videos, with the goal of creating a shared, available dataset for this task.
10 papers · 1 benchmark
EgoProceL is a large-scale dataset for procedure learning.
9 papers · 0 benchmarks
The UCF Sports dataset consists of a set of actions collected from various sports which are typically featured on broadcast television channels such as the BBC and ESPN.
9 papers · 1 benchmark
URFD Dataset (UR Fall Detection Dataset)
This dataset contains 70 (30 falls + 40 activities of daily living) sequences.
7 papers · 0 benchmarks
VidHOI is a video-based human-object interaction detection benchmark.
7 papers · 2 benchmarks
An abnormal activity data-set for research use that contains 4,83,566 annotated frames.
5 papers · 2 benchmarks
The MLB-YouTube dataset is a new, large-scale dataset consisting of 20 baseball games from the 2017 MLB post-season available on YouTube with over 42 hours of video footage.
5 papers · 0 benchmarks
A dataset which provides detailed annotations for activity recognition.
5 papers · 1 benchmark
This dataset has the following citation: M.
5 papers · 1 benchmark
WEAR (WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition)
WEAR is an outdoor sports dataset for both vision- and inertial-based human activity recognition (HAR).
5 papers · 0 benchmarks
ESAD (SARAS Endoscopic Surgeon Action Detection)
ESAD is a large-scale dataset designed to tackle the problem of surgeon action detection in endoscopic minimally invasive surgery.
4 papers · 0 benchmarks
OREBA (Objectively Recognizing Eating Behavior and Associated Intake)
The OREBA dataset aims to provide a comprehensive multi-sensor recording of communal intake occasions for researchers interested in automatic detection of intake gestures.
3 papers · 0 benchmarks
TTStroke-21 ME21 (TTStroke-21 for MediaEval 2021)
This task offers researchers an opportunity to test their fine-grained classification methods for detecting and recognizing strokes in table tennis videos.
3 papers · 2 benchmarks
TTStroke-21 ME22 (TTStroke-21 for MediaEval 2022)
TTStroke-21 for MediaEval 2022.
3 papers · 2 benchmarks
40,764 images (11,659 protest images and hard negatives) with various annotations of visual attributes and sentiments.
2 papers · 0 benchmarks
This dataset contains Axivity AX3 wrist-worn activity tracker data that were collected from 151 participants in 2014-2016 around the Oxfordshire area.
1 paper · 0 benchmarks
This spatio-temporal actions dataset for video understanding consists of 4 parts: original videos, cropped videos, video frames, and annotation files.
1 paper · 0 benchmarks
The LIRIS human activities dataset contains (gray/rgb/depth) videos showing people performing various activities taken from daily life (discussing, telphone calls, giving an item etc.).
1 paper · 0 benchmarks
This dataset was generated to characterize mouse grooming behavior.
1 paper · 0 benchmarks
InfiniteRep is a synthetic, open-source dataset for fitness and physical therapy (PT) applications.
0 papers · 0 benchmarks
Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.