Papers › Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognition
Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognition
Yang Chen, Jingcai Guo, Tian He, Ling Wang
Skeleton-based zero-shot action recognition aims to recognize unknown human actions based on the learned priors of the known skeleton-based actions and a semantic descriptor space shared by both known and unknown categories. However, previous works focus on establishing the bridges between the known skeleton representation space and semantic descriptions space at the coarse-grained level for recognizing unknown action categories, ignoring the fine-grained alignment of these two spaces, resulting in suboptimal performance in distinguishing high-similarity action categories. To address these challenges, we propose a novel method via Side information and dual-prompts learning for skeleton-based zero-shot action recognition (STAR) at the fine-grained level. Specifically, 1) we decompose the skeleton into several parts based on its topology structure and introduce the side information concerning multi-part descriptions of human body movements for alignment between the skeleton and the semantic space at the fine-grained level; 2) we design the visual-attribute and semantic-part prompts to improve the intra-class compactness within the skeleton space and inter-class separability within the semantic space, respectively, to distinguish the high-similarity actions. Extensive experiments show that our method achieves state-of-the-art performance in ZSL and GZSL settings on NTU RGB+D, NTU RGB+D 120, and PKU-MMD datasets.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Zero Shot Skeletal Action Recognition | NTU RGB+D | STAR | Accuracy (12 unseen classes) | 45.10 | #3 of 9 | Archive leaderboard | report |
| Zero Shot Skeletal Action Recognition | NTU RGB+D | STAR | Accuracy (5 unseen classes) | 81.40 | #3 of 9 | Archive leaderboard | report |
| Zero Shot Skeletal Action Recognition | NTU RGB+D | STAR | Random Split Accuracy | 77.50 | #3 of 9 | Archive leaderboard | report |
| Zero Shot Skeletal Action Recognition | NTU RGB+D 120 | STAR | Accuracy (10 unseen classes) | 63.30 | #6 of 9 | Archive leaderboard | report |
| Zero Shot Skeletal Action Recognition | NTU RGB+D 120 | STAR | Accuracy (24 unseen classes) | 44.30 | #6 of 9 | Archive leaderboard | report |
| Zero Shot Skeletal Action Recognition | PKU-MMD | STAR | Random Split Accuracy | 70.60 | #3 of 7 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections