{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/efficient-human-pose-estimation-via-3d-event","title":"Efficient Human Pose Estimation via 3D Event Point Cloud","arxiv_id":"2206.04511","date":"2022-06-09","proceeding":null,"authors":["Jiaan Chen","Hao Shi","Yaozu Ye","Kailun Yang","Lei Sun","Kaiwei Wang"],"abstract":"Human Pose Estimation (HPE) based on RGB images has experienced a rapid development benefiting from deep learning. However, event-based HPE has not been fully studied, which remains great potential for applications in extreme scenes and efficiency-critical conditions. In this paper, we are the first to estimate 2D human pose directly from 3D event point cloud. We propose a novel representation of events, the rasterized event point cloud, aggregating events on the same position of a small time slice. It maintains the 3D features from multiple statistical cues and significantly reduces memory consumption and computation complexity, proved to be efficient in our work. We then leverage the rasterized event point cloud as input to three different backbones, PointNet, DGCNN, and Point Transformer, with two linear layer decoders to predict the location of human keypoints. We find that based on our method, PointNet achieves promising results with much faster speed, whereas Point Transfomer reaches much higher accuracy, even close to previous event-frame-based methods. A comprehensive set of results demonstrates that our proposed method is consistently effective for these 3D backbone models in event-driven human pose estimation. Our method based on PointNet with 2048 points input achieves 82.46mm in MPJPE3D on the DHP19 dataset, while only has a latency of 12.29ms on an NVIDIA Jetson Xavier NX edge computing platform, which is ideally suitable for real-time detection with event cameras. Code is available at https://github.com/MasterHow/EventPointPose.","url_abs":"https://arxiv.org/abs/2206.04511v2","url_pdf":"https://arxiv.org/pdf/2206.04511v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"efficient-human-pose-estimation-via-3d-event","repo_url":"https://github.com/masterhow/eventpointpose","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-human-pose-estimation","task_name":"3D Human Pose Estimation"},{"task_slug":"edge-computing","task_name":"Edge-computing"},{"task_slug":"2048","task_name":"Playing the Game of 2048"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dgcnn","method_name":"DGCNN"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-human-pose-estimation-on-dhp19","task":"3D Human Pose Estimation","dataset":"DHP19","model":"Point Transformer","rank_in_archive_order":1,"of":2,"metrics":{"GFLOPs":"10.06","MPJPE2D":"6.46","MPJPE3D":"73.37","Params (M)":"3.65"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2206.04511","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.04511"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/masterhow/eventpointpose","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":2,"ran_draft_wrong":2,"unverified":4},"by_repo_kind":{"official":{"samples":8,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"295c8424ac32f9cf","entry":"farthest_point_sample","repo":"masterhow/eventpointpose","repo_kind":"official","path":"models/PointTrans_tools.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/models/PointTrans_tools.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"295c8424ac32f9cf"}},{"code_sha256_prefix":"5547bda8a763a5f4","entry":"index_points","repo":"masterhow/eventpointpose","repo_kind":"official","path":"models/PointTrans_tools.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/models/PointTrans_tools.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5547bda8a763a5f4"}},{"code_sha256_prefix":"cdd0141594039dcb","entry":"knn","repo":"masterhow/eventpointpose","repo_kind":"official","path":"models/DGCNN.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/models/DGCNN.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cdd0141594039dcb"}},{"code_sha256_prefix":"74c3fe06cea2f553","entry":"square_distance","repo":"masterhow/eventpointpose","repo_kind":"official","path":"models/PointTrans_tools.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/models/PointTrans_tools.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74c3fe06cea2f553"}},{"code_sha256_prefix":"a21b18dcf8ea0abf","entry":"adjust_target_weight","repo":"masterhow/eventpointpose","repo_kind":"official","path":"dataset/DHP19EPC.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/dataset/DHP19EPC.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a21b18dcf8ea0abf"}},{"code_sha256_prefix":"4a5bd96c473d7a4d","entry":"generate_label","repo":"masterhow/eventpointpose","repo_kind":"official","path":"dataset/DHP19EPC.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/dataset/DHP19EPC.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4a5bd96c473d7a4d"}},{"code_sha256_prefix":"7abde57071cd0268","entry":"generate_sa_simdr","repo":"masterhow/eventpointpose","repo_kind":"official","path":"dataset/DHP19EPC.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/dataset/DHP19EPC.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7abde57071cd0268"}},{"code_sha256_prefix":"ed56c753ee0b0cf9","entry":"get_graph_feature","repo":"masterhow/eventpointpose","repo_kind":"official","path":"models/DGCNN.py","file_url":"https://github.com/masterhow/eventpointpose/blob/HEAD/models/DGCNN.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ed56c753ee0b0cf9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}