{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/global-context-aware-attention-lstm-networks","title":"Global Context-Aware Attention LSTM Networks for 3D Action Recognition","arxiv_id":null,"date":"2017-07-01","proceeding":"CVPR 2017 7","authors":["Jun Liu","Gang Wang","Ping Hu","Ling-Yu Duan","Alex C. Kot"],"abstract":"Long Short-Term Memory (LSTM) networks have shown superior performance in 3D human action recognition due to their power in modeling the dynamics and dependencies in sequential data. Since not all joints are informative for action analysis and the irrelevant joints often bring a lot of noise, we need to pay more attention to the informative ones. However, original LSTM does not have strong attention capability. Hence we propose a new class of LSTM network, Global Context-Aware Attention LSTM (GCA-LSTM), for 3D action recognition, which is able to selectively focus on the informative joints in the action sequence with the assistance of global contextual information. In order to achieve a reliable attention representation for the action sequence, we further propose a recurrent attention mechanism for our GCA-LSTM network, in which the attention performance is improved iteratively. Experiments show that our end-to-end network can reliably focus on the most informative joints in each frame of the skeleton sequence. Moreover, our network yields state-of-the-art performance on three challenging datasets for 3D action recognition.\r","url_abs":"http://openaccess.thecvf.com/content_cvpr_2017/html/Liu_Global_Context-Aware_Attention_CVPR_2017_paper.html","url_pdf":"http://openaccess.thecvf.com/content_cvpr_2017/papers/Liu_Global_Context-Aware_Attention_CVPR_2017_paper.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"3d-human-action-recognition","task_name":"3D Action Recognition"},{"task_slug":"action-analysis","task_name":"Action Analysis"},{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"one-shot-3d-action-recognition","task_name":"One-Shot 3D Action Recognition"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/one-shot-3d-action-recognition-on-ntu-rgbd","task":"One-Shot 3D Action Recognition","dataset":"NTU RGB+D 120","model":"Fully Connected","rank_in_archive_order":9,"of":10,"metrics":{"Accuracy":"42.1%"},"uses_additional_data":false},{"leaderboard":"/sota/one-shot-3d-action-recognition-on-ntu-rgbd","task":"One-Shot 3D Action Recognition","dataset":"NTU RGB+D 120","model":"Attention Network","rank_in_archive_order":10,"of":10,"metrics":{"Accuracy":"41.0%"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D","model":"GCA-LSTM","rank_in_archive_order":119,"of":135,"metrics":{"Accuracy (CS)":"76.10","Accuracy (CV)":"84.00"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd-1","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D 120","model":"GCA-LSTM","rank_in_archive_order":78,"of":83,"metrics":{"Accuracy (Cross-Setup)":"59.2%","Accuracy (Cross-Subject)":"58.3%"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}