Papers › PA3D: Pose-Action 3D Machine for Video Recognition

PA3D: Pose-Action 3D Machine for Video Recognition

1 Jun 2019CVPR 2019 6archive 2025-07-28

An Yan, Yali Wang, Zhifeng Li, Yu Qiao

Recent studies have witnessed the successes of using 3D CNNs for video action recognition. However, most 3D models are built upon RGB and optical flow streams, which may not fully exploit pose dynamics, i.e., an important cue of modeling human actions. To fill this gap, we propose a concise Pose-Action 3D Machine (PA3D), which can effectively encode multiple pose modalities within a unified 3D framework, and consequently learn spatio-temporal pose representations for action recognition. More specifically, we introduce a novel temporal pose convolution to aggregate spatial poses over frames. Unlike the classical temporal convolution, our operation can explicitly learn the pose motions that are discriminative to recognize human actions. Extensive experiments on three popular benchmarks (i.e., JHMDB, HMDB, and Charades) show that, PA3D outperforms the recent pose-based approaches. Furthermore, PA3D is highly complementary to the recent 3D CNNs, e.g., I3D. Multi-stream fusion achieves the state-of-the-art performance on all evaluated data sets.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action RecognitionOptical Flow EstimationSkeleton Based Action RecognitionTemporal Action LocalizationVideo Recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Action Classification Charades PA3D + (GCN + I3D + NL I3D) MAP 41 #31 of 49 Archive leaderboard report
Skeleton Based Action Recognition J-HMDB PA3D+RPAN Accuracy (RGB+pose) 86.1 #2 of 13 Archive leaderboard report
Skeleton Based Action Recognition J-HMDB PA3D Accuracy (RGB+pose) 69.5 #8 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections