Datasets › Breakfast

Breakfast (The Breakfast Actions Dataset)

Introduced by Hilde Kuehne et al. in The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities1 Jan 2014 archive 2025-07-28

The Breakfast Actions Dataset comprises of 10 actions related to breakfast preparation, performed by 52 different individuals in 18 different kitchens. The dataset is one of the largest fully annotated datasets available. The actions are recorded “in the wild” as opposed to a single controlled lab environment. It consists of over 77 hours of video recordings.

Source: https://serre-lab.clps.brown.edu/resource/breakfast-actions-dataset/ Image Source: https://serre-lab.clps.brown.edu/resource/breakfast-actions-dataset/

Benchmarks archive 2025-07-28

All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

30 shown of 56 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 179. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
Hierarchical Vector Quantization for Unsupervised Action Segmentation 1 1 23 Dec 2024 not harvested
ASQuery: A Query-based Model for Action Segmentation 1 1 30 Sep 2024 not harvested
HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics 1 1 30 Aug 2024 ran 7 of 9 samples (2 unverified)
Efficient Temporal Action Segmentation via Boundary-aware Query Voting 1 1 25 May 2024 not harvested
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding 1 1 8 Apr 2024 ran 7 of 9 samples (2 unverified)
Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation 1 1 1 Apr 2024 not harvested
FACT: Frame-Action Cross-Attention Temporal Modeling for Efficient Action Segmentation 1 1 1 Jan 2024 not harvested
Towards Weakly Supervised End-to-end Learning for Long-video Action Recognition 0 6 28 Nov 2023 not harvested
Is Weakly-supervised Action Segmentation Ready For Human-Robot Interaction? No, Let's Improve It With Action-union Learning 1 1 22 Oct 2023 not harvested
BIT: Bi-Level Temporal Modeling for Efficient Supervised Action Segmentation 0 1 28 Aug 2023 not harvested
How Much Temporal Long-Term Context is Needed for Action Segmentation? 1 1 22 Aug 2023 ran 6 of 6 samples (0 unverified; 6 pointer-only for licence)
SF-TMN: SlowFast Temporal Modeling Network for Surgical Phase Recognition 0 1 15 Jun 2023 not harvested
Permutation-Aware Action Segmentation via Unsupervised Frame-to-Segment Alignment 1 1 31 May 2023 not harvested
Leveraging triplet loss for unsupervised action segmentation 1 3 13 Apr 2023 not harvested
Diffusion Action Segmentation 1 1 31 Mar 2023 ran 5 of 9 samples (4 unverified)
Selective Structured State-Spaces for Long-Form Video Understanding 0 1 25 Mar 2023 not harvested
ASPnet: Action Segmentation With Shared-Private Representation of Multiple Data Sources 0 1 1 Jan 2023 not harvested
Efficient Movie Scene Detection using State-Space Transformers 1 1 29 Dec 2022 ran 3 of 3 samples (0 unverified)
Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation 2 1 1 Sep 2022 ran 2 of 2 samples (0 unverified; 2 pointer-only for licence)
RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks 2 1 14 Jun 2022 ran 2 of 3 samples (1 unverified; 3 pointer-only for licence)
Do we really need temporal convolutions in action segmentation? 1 1 26 May 2022 not harvested
Cross-Enhancement Transformer for Action Segmentation 1 1 19 May 2022 not harvested
Maximization and restoration: Action segmentation through dilation passing and temporal reconstruction 0 1 2 May 2022 not harvested
Long Movie Clip Classification with State-Space Video Models 1 1 4 Apr 2022 ran 11 of 18 samples (7 unverified; 2 pointer-only for licence)
Learning To Recognize Procedural Activities with Distant Supervision 1 1 26 Jan 2022 not harvested
Set-Supervised Action Learning in Procedural Task Videos via Pairwise Order Consistency 1 1 1 Jan 2022 not harvested
ASFormer: Transformer for Action Segmentation 1 1 16 Oct 2021 ran 1 of 1 samples (0 unverified)
FIFA: Fast Inference Approximation for Action Segmentation 0 2 9 Aug 2021 not harvested
Graph-Based High-Order Relation Modeling for Long-Term Action Recognition 0 2 19 Jun 2021 not harvested
Unsupervised Action Segmentation by Joint Representation Learning and Online Clustering 1 2 27 May 2021 ran 0 of 2 samples (2 unverified)

The full list of 56 is in the JSON twin.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Breakfast

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections