{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/skelemotion-a-new-representation-of-skeleton","title":"SkeleMotion: A New Representation of Skeleton Joint Sequences Based on Motion Information for 3D Action Recognition","arxiv_id":"1907.13025","date":"2019-07-30","proceeding":null,"authors":["Carlos Caetano","Jessica Sena","François Brémond","Jefersson A. dos Santos","William Robson Schwartz"],"abstract":"Due to the availability of large-scale skeleton datasets, 3D human action recognition has recently called the attention of computer vision community. Many works have focused on encoding skeleton data as skeleton image representations based on spatial structure of the skeleton joints, in which the temporal dynamics of the sequence is encoded as variations in columns and the spatial structure of each frame is represented as rows of a matrix. To further improve such representations, we introduce a novel skeleton image representation to be used as input of Convolutional Neural Networks (CNNs), named SkeleMotion. The proposed approach encodes the temporal dynamics by explicitly computing the magnitude and orientation values of the skeleton joints. Different temporal scales are employed to compute motion values to aggregate more temporal dynamics to the representation making it able to capture longrange joint interactions involved in actions as well as filtering noisy motion values. Experimental results demonstrate the effectiveness of the proposed representation on 3D action recognition outperforming the state-of-the-art on NTU RGB+D 120 dataset.","url_abs":"https://arxiv.org/abs/1907.13025v1","url_pdf":"https://arxiv.org/pdf/1907.13025v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"skelemotion-a-new-representation-of-skeleton","repo_url":"https://github.com/carloscaetano/skeleton-images","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"3d-human-action-recognition","task_name":"3D Action Recognition"},{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-in-videos-on-ntu-rgbd","task":"Action Recognition","dataset":"NTU RGB+D","model":"Skelemotion + Yang et al. (Skeleton only)","rank_in_archive_order":27,"of":28,"metrics":{"Accuracy (CS)":"76.5","Accuracy (CV)":"84.7"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-in-videos-on-ntu-rgbd-120","task":"Action Recognition","dataset":"NTU RGB+D 120","model":"Skelemotion + Yang et al. (skeleton only)","rank_in_archive_order":20,"of":21,"metrics":{"Accuracy (Cross-Setup)":"66.9","Accuracy (Cross-Subject)":"67.7"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D","model":"Skelemotion + Yang et al.","rank_in_archive_order":118,"of":135,"metrics":{"Accuracy (CS)":"76.5","Accuracy (CV)":"84.7"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd-1","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D 120","model":"SkeleMotion + Yang et al. (2018)","rank_in_archive_order":69,"of":83,"metrics":{"Accuracy (Cross-Setup)":"66.9%","Accuracy (Cross-Subject)":"67.7%"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd-1","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D 120","model":"SkeleMotion [Magnitude-Orientation (TSA)]","rank_in_archive_order":72,"of":83,"metrics":{"Accuracy (Cross-Setup)":"63.0%","Accuracy (Cross-Subject)":"62.9%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1907.13025","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.13025"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/carloscaetano/skeleton-images","reach":null}],"summary":{"ran_draft_wrong":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"c6322ba2c1b13230","entry":"get_arguments","repo":"carloscaetano/skeleton-images","repo_kind":"official","path":"GenerateSkeletonImages.py","file_url":"https://github.com/carloscaetano/skeleton-images/blob/HEAD/GenerateSkeletonImages.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c6322ba2c1b13230"}},{"code_sha256_prefix":"2699ee39ed0cd298","entry":"get_skeleton_files","repo":"carloscaetano/skeleton-images","repo_kind":"official","path":"GenerateSkeletonImages.py","file_url":"https://github.com/carloscaetano/skeleton-images/blob/HEAD/GenerateSkeletonImages.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2699ee39ed0cd298"}},{"code_sha256_prefix":"b4a7ab53252cfcf7","entry":"worker","repo":"carloscaetano/skeleton-images","repo_kind":"official","path":"GenerateSkeletonImages.py","file_url":"https://github.com/carloscaetano/skeleton-images/blob/HEAD/GenerateSkeletonImages.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b4a7ab53252cfcf7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}