Temporal Action Segmentation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 35 papers with code (62 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Hierarchical NeuroSymbolic Approach for Comprehensive and Explainable Action Quality Assessment
  20 Mar 2024 3 repositories listed
  We found that domain experts prefer our system and find it more informative than purely neural approaches to AQA in diving.
• Temporal Action Segmentation: An Analysis of Modern Techniques
  19 Oct 2022 3 repositories listed Syntology ran 2 of 4 samples · 2 unverified
  Temporal action segmentation (TAS) in videos aims at densely identifying video frames in minutes-long videos with multiple action classes.
• Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation
  1 Sep 2022 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  This paper introduces a unified framework for video action segmentation via sequence to sequence (seq2seq) translation in a fully and timestamp supervised setup.
• RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks
  14 Jun 2022 2 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  Our search scheme exploits both global search to find the coarse combinations and local search to get the refined receptive field combinations further.
• MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation
  5 Mar 2019 2 repositories listed
  Temporally locating and classifying action segments in long untrimmed videos is of particular interest to many applications like surveillance and robotics.
• Cost-Sensitive Learning for Long-Tailed Temporal Action Segmentation
  24 Mar 2025 1 repository listed
  In temporal action segmentation approaches, we identified a bi-level learning bias.
• Hierarchical Vector Quantization for Unsupervised Action Segmentation
  23 Dec 2024 1 repository listed
  In this work, we address unsupervised temporal action segmentation, which segments a set of long, untrimmed videos into semantically meaningful segments that are consistent across videos.
• OnlineTAS: An Online Baseline for Temporal Action Segmentation
  2 Nov 2024 1 repository listed
  Temporal context plays a significant role in temporal action segmentation.
• Language-Assisted Skeleton Action Understanding for Skeleton-Based Temporal Action Segmentation
  31 Oct 2024 1 repository listed
  Regarding action relationships, the Action Relationships Supervision (ARS) module enhances the discrimination across action classes through contrastive learning of single-class action-text pairs and models the semantic…
• ProMQA: Question Answering Dataset for Multimodal Procedural Activity Understanding
  29 Oct 2024 1 repository listed
  Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals.
• Language-Assisted Human Part Motion Learning for Skeleton-Based Temporal Action Segmentation
  8 Oct 2024 1 repository listed
  To address these limitations, we propose a novel method named Language-assisted Human Part Motion Representation Learning (LPL), which contains a Disentangled Part Motion Encoder (DPE) to extract dual-level (i.
• ASQuery: A Query-based Model for Action Segmentation
  30 Sep 2024 1 repository listed
  For the task of temporal action segmentation, existing works commonly treat it as a frame-wise classification problem.
• 3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach
  29 Aug 2024 1 repository listed
  In the experimental results, we validated the usefulness of 3D pose features as input and the fine-grained dataset for the TAS model in figure skating.
• Long-Tail Temporal Action Segmentation with Group-wise Temporal Logit Adjustment
  19 Aug 2024 1 repository listed
  However, state-of-the-art temporal action segmentation methods overlook the long tail and fail to recognize tail actions.
• Efficient Temporal Action Segmentation via Boundary-aware Query Voting
  25 May 2024 1 repository listed
  Although the performance of Temporal Action Segmentation (TAS) has improved in recent years, achieving promising results often comes with a high computational cost due to dense inputs, complex model structures, and…
• Snippet-Aware Transformer With Multiple Action Elements for Skeleton-Based Action Segmentation
  6 May 2024 1 repository listed
  To address these limitations, the snippet-aware Transformer with multiple action element (ME-ST) is proposed to enhance the discrimination and segmentation among actions, which leverages intrasnippet attention along…
• A Multimodal Handover Failure Detection Dataset and Baselines
  28 Feb 2024 1 repository listed
  To address this deficit, we present the multimodal Handover Failure Detection dataset, which consists of failures induced by the human participant, such as ignoring the robot or not releasing the object.
• SMC-NCA: Semantic-guided Multi-level Contrast for Semi-supervised Temporal Action Segmentation
  19 Dec 2023 1 repository listed
  However, learning the representation of each frame by unsupervised contrastive learning for action segmentation remains an open and challenging problem.
• Activity Grammars for Temporal Action Segmentation
  7 Dec 2023 1 repository listed Syntology ran 5 of 6 samples · 1 unverified
  Sequence prediction on temporal data requires the ability to understand compositional structures of multi-level semantics beyond individual and contextual properties.
• End-to-End Streaming Video Temporal Action Segmentation with Reinforce Learning
  27 Sep 2023 1 repository listed
  The streaming temporal action segmentation (STAS) task, a supplementary task of temporal action segmentation (TAS), has not received adequate attention in the field of video understanding.
• OTAS: Unsupervised Boundary Detection for Object-Centric Temporal Action Segmentation
  12 Sep 2023 1 repository listed
  In this paper, we explore the merits of local features by proposing the unsupervised framework of Object-centric Temporal Action Segmentation (OTAS).
• How Much Temporal Long-Term Context is Needed for Action Segmentation?
  22 Aug 2023 1 repository listed Syntology ran 6 of 6 samples · 0 unverified · 6 pointer-only (licence)
  In this work, we try to answer how much long-term temporal context is required for temporal action segmentation by introducing a transformer-based model that leverages sparse attention to capture the full context of a…
• Diffusion Action Segmentation
  31 Mar 2023 1 repository listed Syntology ran 5 of 9 samples · 4 unverified
  Temporal action segmentation is crucial for understanding long-form videos.
• Streaming Video Temporal Action Segmentation In Real Time
  28 Sep 2022 1 repository listed
  As the real-time action segmentation task is different from TAS task, we define it as streaming video real-time temporal action segmentation (SVTAS) task.
• Iterative Contrast-Classify For Semi-supervised Temporal Action Segmentation
  2 Dec 2021 1 repository listed Syntology ran 0 of 10 samples · 10 unverified
  Our method hinges on unsupervised representation learning, which, for temporal action segmentation, poses unique challenges.
• Efficient Two-Step Networks for Temporal Action Segmentation
  30 Apr 2021 1 repository listed
  Due to boundary ambiguity and over-segmentation issues, identifying all the frames in long untrimmed videos is still challenging.
• Temporal Action Segmentation from Timestamp Supervision
  11 Mar 2021 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  To demonstrate the effectiveness of timestamp supervision, we propose an approach to train a segmentation model using only timestamps annotations.
• Refining Action Segmentation With Hierarchical Video Representations
  1 Jan 2021 1 repository listed
  In this paper, we propose Hierarchical Action Segmentation Refiner (HASR), which can refine temporal action segmentation results from various models by understanding the overall context of a given video in a…
• Online Spatiotemporal Action Detection and Prediction via Causal Representations
  31 Aug 2020 1 repository listed
  In this thesis, we focus on video action understanding problems from an online and real-time processing point of view.
• Boundary-Aware Cascade Networks for Temporal Action Segmentation
  1 Aug 2020 1 repository listed
  To address these problems, we present a new boundary-aware cascade network by introducing two novel components.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.