</> Code with Papers by Syntology

Home › Datasets › task › Action Segmentation

Action Segmentation datasets

archive 2025-07-28

18 datasets carry the task tag "Action Segmentation" (the task itself: Action Segmentation), ordered by the archive's paper count. Page 1 of 1: 18 shown of 18. Facet routes are this site's own (the archive records the tag string, not a page).

The archive holds 12,214 dataset rows; 12,172 are listed. 6 are withheld from every listing and count here as vandalised before snapshot (6 with contact-centre spam in the title, 0 with a spam description on a row that has no homepage, no paper and no papers counted; none with more than 1 paper, 0 with a benchmark), listed in withheld.json; 1 listed row carries a vandalised description, withheld on its page. This gate never withholds a row with a homepage or a paper that resolves, and a clean description; the content rules below withhold a row whose name is spam whatever else it carries. The gate is a phrase list: these are the rows it caught, not a claim that the rest is clean. Before that gate, the site's content rules withhold 36 more rows (invite-code, gambling, travel-booking, contact-centre and similar spam in the name or on a row with nothing real behind it); they have no page and are listed in withheld.json.

Filter 51 task tags shown of 3,717, by dataset count; the full filter by modality, task and language is on /datasets

All 12,172 Question Answering 413Semantic Segmentation 347Object Detection 332Image Classification 283Classification 222Text Classification 167Language Modelling 166Text Generation 162Visual Question Answering (VQA) 144Named Entity Recognition (NER) 130Pose Estimation 124Anomaly Detection 119Action Recognition 115Instance Segmentation 111Sentiment Analysis 104Text Summarization 98Domain Adaptation 96Speech Recognition 96Reading Comprehension 95Information Retrieval 932D Object Detection 92Image Retrieval 87Machine Translation 82Relation Extraction 822D Semantic Segmentation 81Natural Language Inference 81Image Captioning 79Image Generation 79Depth Estimation 77Node Classification 75Natural Language Understanding 72Autonomous Driving 70Code Generation 70Object Tracking 693D Object Detection 67Face Recognition 67Link Prediction 67Person Re-Identification 65Data Augmentation 63Multi-Task Learning 593D Reconstruction 58Common Sense Reasoning 56Recommendation Systems 56Video Understanding 56Optical Character Recognition (OCR) 55Graph Classification 54Abstractive Text Summarization 52Emotion Recognition 52Medical Image Segmentation 52Word Embeddings 52Action Segmentation 18

Action Segmentation datasets 1–18 of 18

Breakfast (The Breakfast Actions Dataset)
The Breakfast Actions Dataset comprises of 10 actions related to breakfast preparation, performed by 52 different individuals in 18 different kitchens.
VideosActionsAction SegmentationVideo ClassificationUnsupervised Action SegmentationWeakly Supervised Action Segmentation (Transcript)Weakly Supervised Action Segmentation (Action Set))Long-video Activity Recognition
179 papers · 6 benchmarks
GTEA (Georgia Tech Egocentric Activity)
The Georgia Tech Egocentric Activities (GTEA) dataset contains seven types of daily activities such as making sandwich, tea, or coffee.
ImagesVideosAction SegmentationWeakly Supervised Action LocalizationFine-Grained Action Detection
120 papers · 2 benchmarks
COIN
The COIN dataset (a large-scale dataset for COmprehensive INstructional video analysis) consists of 11,827 videos related to 180 different tasks in 12 domains (e.g., vehicles, gadgets, etc.) related to our daily life.
VideosAction RecognitionAction LocalizationTemporal Action LocalizationAction SegmentationVideo Classification
105 papers · 2 benchmarks
JIGSAWS (JHU-ISI Gesture and Skill Assessment Working Set)
The JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) is a surgical activity dataset for human motion modeling.
VideosAction SegmentationAction Quality AssessmentSurgical Skills Evaluation
105 papers · 3 benchmarks
Assembly101
Assembly101 is a new procedural activity dataset featuring 4321 videos of people assembling and disassembling 101 "take-apart" toy vehicles.
VideosAction Recognition3D Action RecognitionAction SegmentationAction AnticipationOpen Vocabulary Action RecognitionMistake Detection
57 papers · 4 benchmarks
50 Salads
Activity recognition research has shifted focus from distinguishing full-body motion patterns to recognizing complex interactions of multiple entities.
VideosAction SegmentationUnsupervised Action Segmentation
35 papers · 2 benchmarks
HOI4D
A large-scale 4D egocentric dataset with rich annotations, to catalyze the research of category-level human-object interaction.
VideosSemantic SegmentationPanoptic SegmentationPose TrackingAction SegmentationHuman-Object Interaction DetectionMotion Segmentation
23 papers · 0 benchmarks
Watch-n-Patch
The Watch-n-Patch dataset was created with the focus on modeling human activities, comprising multiple actions in a completely unsupervised setting.
ImagesInteractiveAction RecognitionAction SegmentationHuman-Object Interaction Detection
13 papers · 0 benchmarks
EgoExoLearn
EgoExoLearn is a fascinating dataset designed to bridge the gap between egocentric and exocentric views of procedural activities.
Action RecognitionVideo RetrievalVideo CaptioningAction SegmentationAction Quality AssessmentAction Anticipation+1 tasks
12 papers · 3 benchmarks
EgoProceL
EgoProceL is a large-scale dataset for procedure learning.
VideosTextsAction DetectionAction SegmentationVideo SegmentationEvent SegmentationWeakly Supervised Action Segmentation (Transcript)
9 papers · 0 benchmarks
Youtube INRIA Instructional (Unsupervised learning from narrated instruction videos)
We address the problem of automatically learning the main steps to complete a certain task, such as changing a car tire, from a set of narrated instruction videos.
Action SegmentationUnsupervised Action Segmentation
8 papers · 2 benchmarks
TUM Kitchen
The TUM Kitchen dataset is an action recognition dataset that contains 20 video sequences captured by 4 cameras with overlapping views.
ImagesVideosAction RecognitionTemporal Action LocalizationAction Segmentation
7 papers · 0 benchmarks
MPII Cooking 2 Dataset
A dataset which provides detailed annotations for activity recognition.
VideosActivity RecognitionTemporal Action LocalizationAction DetectionAction Segmentation
5 papers · 1 benchmark
HA-ViD (HA-ViD: A Human Assembly Video Dataset)
Understanding comprehensive assembly knowledge from videos is critical for futuristic ultra-intelligent industry.
ImagesVideosRGB-DActionsTrackingRGB VideoObject DetectionAction RecognitionMulti-Object TrackingAction Segmentation
1 paper · 0 benchmarks
InHARD (Industrial Human Action Recognition Dataset in the Context of Industrial Collaborative Robotics)
We introduce a RGB+S dataset named “Industrial Human Action Recognition Dataset” (InHARD) from a real-world setting for industrial human action recognition with over 2 million frames, collected from 16 distinct subjects.
VideosRGB-DAction RecognitionAction Segmentation
1 paper · 0 benchmarks
LARa (Logistic Activity Recognition Challenge)
LARa is the first freely accessible logistics-dataset for human activity recognition.
Time seriesActionsAction Segmentation
1 paper · 0 benchmarks
UW IOM (University of Washington Indoor Object Manipulation)
Comprises twenty individuals picking up and placing objects of varying weights to and from cabinet and table locations at various heights.
ImagesAction Segmentation
1 paper · 0 benchmarks
SICS-155 (Phase Recognition in Small Incision Cataract Surgery Videos)
Cataract is the leading cause of blindness worldwide, most affecting life in low- and middle-income countries (LMICs).
VideosMedicalAction SegmentationSurgical phase recognitionTemporal Action Segmentation
0 papers · 0 benchmarks

Paper counts and descriptions are the archive's, frozen 2025-07-28; no citation counts, no stars, no trending. Sorting by "most cited" or "newest" was a live-site feature the archive does not carry.