Papers › Action Capsules: Human Skeleton Action Recognition

Action Capsules: Human Skeleton Action Recognition

30 Jan 2023arXiv:2301.13090archive 2025-07-28

Ali Farajzadeh Bavil, Hamed Damirchi, Hamid D. Taghirad

Due to the compact and rich high-level representations offered, skeleton-based human action recognition has recently become a highly active research topic. Previous studies have demonstrated that investigating joint relationships in spatial and temporal dimensions provides effective information critical to action recognition. However, effectively encoding global dependencies of joints during spatio-temporal feature extraction is still challenging. In this paper, we introduce Action Capsule which identifies action-related key joints by considering the latent correlation of joints in a skeleton sequence. We show that, during inference, our end-to-end network pays attention to a set of joints specific to each action, whose encoded spatio-temporal features are aggregated to recognize the action. Additionally, the use of multiple stages of action capsules enhances the ability of the network to classify similar actions. Consequently, our network outperforms the state-of-the-art approaches on the N-UCLA dataset and obtains competitive results on the NTURGBD dataset. This is while our approach has significantly lower computational requirements based on GFLOPs measurements.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Skeleton Based Action Recognition N-UCLA Action Capsules Accuracy 97.3 #6 of 25 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D Action Capsules Accuracy (CS) 90 #53 of 135 Archive leaderboard report
Skeleton Based Action Recognition NTU RGB+D Action Capsules Accuracy (CV) 96.3 #53 of 135 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Capsule Network

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections