Papers › Maximization and restoration: Action segmentation through dilation passing and...

Maximization and restoration: Action segmentation through dilation passing and temporal reconstruction

2 May 2022Pattern Recognition 2022 5archive 2025-07-28

Junyong Park, Daekyum Kim, Sejoon Huh, Sungho Jo

Action segmentation aims to split videos into segments of different actions. Recent work focuses on dealing with long-range dependencies of long, untrimmed videos, but still suffers from over-segmentation and performance saturation due to increased model complexity. This paper addresses the aforementioned issues through a divide-and-conquer strategy that first maximizes the frame-wise classification accuracy of the model and then reduces the over-segmentation errors. This strategy is implemented with the Dilation Passing and Reconstruction Network, composed of the Dilation Passing Network, which primarily aims to increase accuracy by propagating information of different dilations, and the Temporal Reconstruction Network, which reduces over-segmentation errors by temporally encoding and decoding the output features from the Dilation Passing Network. We also propose a weighted temporal mean squared error loss that further reduces over-segmentation. Through evaluations on the 50Salads, GTEA, and Breakfast datasets, we show that our model achieves significant results compared to existing state-of-the-art models.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action SegmentationSegmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Action Segmentation 50 Salads DPRN Acc 87.2 #11 of 28 Archive leaderboard report
Action Segmentation 50 Salads DPRN Edit 82.0 #11 of 28 Archive leaderboard report
Action Segmentation 50 Salads DPRN F1@10% 87.8 #11 of 28 Archive leaderboard report
Action Segmentation 50 Salads DPRN F1@25% 86.3 #11 of 28 Archive leaderboard report
Action Segmentation 50 Salads DPRN F1@50% 79.4 #11 of 28 Archive leaderboard report
Action Segmentation Breakfast DPRN Acc 71.7 #14 of 37 Archive leaderboard report
Action Segmentation Breakfast DPRN Average F1 67.9 #14 of 37 Archive leaderboard report
Action Segmentation Breakfast DPRN Edit 75.1 #14 of 37 Archive leaderboard report
Action Segmentation Breakfast DPRN F1@10% 75.6 #14 of 37 Archive leaderboard report
Action Segmentation Breakfast DPRN F1@25% 70.5 #14 of 37 Archive leaderboard report
Action Segmentation Breakfast DPRN F1@50% 57.6 #14 of 37 Archive leaderboard report
Action Segmentation GTEA DPRN Acc 82.0 #7 of 28 Archive leaderboard report
Action Segmentation GTEA DPRN Edit 90.9 #7 of 28 Archive leaderboard report
Action Segmentation GTEA DPRN F1@10% 92.9 #7 of 28 Archive leaderboard report
Action Segmentation GTEA DPRN F1@25% 92.0 #7 of 28 Archive leaderboard report
Action Segmentation GTEA DPRN F1@50% 82.9 #7 of 28 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections