Datasets › Breakfast

Breakfast (The Breakfast Actions Dataset)

Introduced by Hilde Kuehne et al. in The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities1 Jan 2014 archive 2025-07-28

The Breakfast Actions Dataset comprises of 10 actions related to breakfast preparation, performed by 52 different individuals in 18 different kitchens. The dataset is one of the largest fully annotated datasets available. The actions are recorded “in the wild” as opposed to a single controlled lab environment. It consists of over 77 hours of video recordings.

Source: https://serre-lab.clps.brown.edu/resource/breakfast-actions-dataset/ Image Source: https://serre-lab.clps.brown.edu/resource/breakfast-actions-dataset/

Benchmarks archive 2025-07-28

All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

papers with a benchmark row: 56 · with a code link: 39 · where Syntology ran a sample: 14 (12 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (14 of 56 with a benchmark row: 12 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 56 of 56 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 179. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Hierarchical Vector Quantization for Unsupervised Action Segmentation 1 1 23 Dec 2024 not harvested
ASQuery: A Query-based Model for Action Segmentation 1 1 30 Sep 2024 not harvested
HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics 1 1 30 Aug 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
Efficient Temporal Action Segmentation via Boundary-aware Query Voting 1 1 25 May 2024 not harvested
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding 1 1 8 Apr 2024 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation 1 1 1 Apr 2024 not harvested
FACT: Frame-Action Cross-Attention Temporal Modeling for Efficient Action Segmentation 1 1 1 Jan 2024 not harvested
Towards Weakly Supervised End-to-end Learning for Long-video Action Recognition 0 6 28 Nov 2023 not harvested
Is Weakly-supervised Action Segmentation Ready For Human-Robot Interaction? No, Let's Improve It With Action-union Learning 1 1 22 Oct 2023 not harvested
BIT: Bi-Level Temporal Modeling for Efficient Supervised Action Segmentation 0 1 28 Aug 2023 not harvested
How Much Temporal Long-Term Context is Needed for Action Segmentation? 1 1 22 Aug 2023 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (6 pointer-only for licence)
SF-TMN: SlowFast Temporal Modeling Network for Surgical Phase Recognition 0 1 15 Jun 2023 not harvested
Permutation-Aware Action Segmentation via Unsupervised Frame-to-Segment Alignment 1 1 31 May 2023 not harvested
Leveraging triplet loss for unsupervised action segmentation 1 3 13 Apr 2023 not harvested
Diffusion Action Segmentation 1 1 31 Mar 2023 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified
Selective Structured State-Spaces for Long-Form Video Understanding 0 1 25 Mar 2023 not harvested
ASPnet: Action Segmentation With Shared-Private Representation of Multiple Data Sources 0 1 1 Jan 2023 not harvested
Efficient Movie Scene Detection using State-Space Transformers 1 1 29 Dec 2022 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified
Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation 2 1 1 Sep 2022 official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks 2 1 14 Jun 2022 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence)
Do we really need temporal convolutions in action segmentation? 1 1 26 May 2022 not harvested
Cross-Enhancement Transformer for Action Segmentation 1 1 19 May 2022 not harvested
Maximization and restoration: Action segmentation through dilation passing and temporal reconstruction 0 1 2 May 2022 not harvested
Long Movie Clip Classification with State-Space Video Models 1 1 4 Apr 2022 official (archive's flag): 9 ran · 11 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 7 unverified (2 pointer-only for licence)
Learning To Recognize Procedural Activities with Distant Supervision 1 1 26 Jan 2022 not harvested
Set-Supervised Action Learning in Procedural Task Videos via Pairwise Order Consistency 1 1 1 Jan 2022 not harvested
ASFormer: Transformer for Action Segmentation 1 1 16 Oct 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
FIFA: Fast Inference Approximation for Action Segmentation 0 2 9 Aug 2021 not harvested
Graph-Based High-Order Relation Modeling for Long-Term Action Recognition 0 2 19 Jun 2021 not harvested
Unsupervised Action Segmentation by Joint Representation Learning and Online Clustering 1 2 27 May 2021 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Coarse to Fine Multi-Resolution Temporal Convolutional Network 1 1 23 May 2021 not harvested
Efficient Two-Step Networks for Temporal Action Segmentation 1 1 30 Apr 2021 not harvested
Unsupervised Discriminative Embedding for Sub-Action Learning in Complex Activities 0 1 30 Apr 2021 not harvested
Action Segmentation with Mixed Temporal Domain Adaptation 0 1 15 Apr 2021 not harvested
Action Shuffle Alternating Learning for Unsupervised Action Segmentation 0 1 5 Apr 2021 not harvested
Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation 1 1 20 Mar 2021 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (1 pointer-only for licence)
Depthwise Separable Temporal Convolutional Network for Action Segmentation 0 1 19 Jan 2021 not harvested
Global2Local: Efficient Structure Search for Video Action Segmentation 2 1 4 Jan 2021 community repositories only · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (3 pointer-only for licence)
Refining Action Segmentation With Hierarchical Video Representations 1 1 1 Jan 2021 not harvested
Weakly-Supervised Action Segmentation and Alignment via Transcript-Aware Union-of-Subspaces Learning 1 1 1 Jan 2021 not harvested
Temporal Relational Modeling with Self-Supervision for Action Segmentation 1 1 14 Dec 2020 not harvested
Boundary-Aware Cascade Networks for Temporal Action Segmentation 1 1 1 Aug 2020 not harvested
Alleviating Over-segmentation Errors by Detecting Action Boundaries 1 1 14 Jul 2020 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
MS-TCN++: Multi-Stage Temporal Convolutional Network for Action Segmentation 1 2 16 Jun 2020 not harvested
Improving Action Segmentation via Graph-Based Temporal Reasoning 0 1 1 Jun 2020 not harvested
Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation 1 1 5 Mar 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
Weakly Supervised Energy-Based Learning for Action Segmentation 1 1 28 Sep 2019 not harvested
VideoGraph: Recognizing Minutes-Long Human Activities in Videos 0 2 13 May 2019 not harvested
Unsupervised learning of action classes with continuous temporal embedding 2 1 8 Apr 2019 not harvested
Fast Weakly Supervised Action Segmentation Using Mutual Consistency 1 2 5 Apr 2019 not harvested
MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation 2 2 5 Mar 2019 not harvested
D3TW: Discriminative Differentiable Dynamic Time Warping for Weakly Supervised Action Alignment and Segmentation 0 1 9 Jan 2019 not harvested
Timeception for Complex Action Recognition 3 2 4 Dec 2018 not harvested
A Perceptual Prediction Framework for Self Supervised Event Segmentation 1 1 12 Nov 2018 official: harvested, nothing ran · 0 ran · 1 unverified
NeuralNetwork-Viterbi: A Framework for Weakly Supervised Video Learning 0 1 17 May 2018 not harvested
ActionVLAD: Learning spatio-temporal aggregation for action classification 0 1 10 Apr 2017 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Breakfast

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections