Papers › Rethinking Masked Representation Learning for 3D Point Cloud Understanding

Rethinking Masked Representation Learning for 3D Point Cloud Understanding

26 Dec 2024IEEE Transactions on Image Processing 2024 12archive 2025-07-28

Chuxin Wang, Yixin Zha, Jianfeng He, Wenfei Yang, Tianzhu Zhang

Self-supervised point cloud representation learning aims to acquire robust and general feature representations from unlabeled data. Recently, masked point modeling-based methods have shown significant performance improvements for point cloud understanding, yet these methods rely on overlapping grouping strategies (k-nearest neighbor algorithm) resulting in early leakage of structural information of mask groups, and overlook the semantic modeling of object components resulting in parts with the same semantics having obvious feature differences due to position differences. In this work, we rethink grouping strategies and pretext tasks that are more suitable for self-supervised point cloud representation learning and propose a novel hierarchical masked representation learning method, including an optimal transport-based hierarchical grouping strategy, a prototype-based part modeling module, and a hierarchical attention encoder. The proposed method enjoys several merits. First, the proposed grouping strategy partitions the point cloud into non-overlapping groups, eliminating the early leakage of structural information in the masked groups. Second, the proposed prototype-based part modeling module dynamically models different object components, ensuring feature consistency on parts with the same semantics. Extensive experiments on four downstream tasks demonstrate that our method surpasses state-of-the-art 3D representation learning methods. Comprehensive ablation studies and visualizations demonstrate the effectiveness of the proposed modules.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Part Segmentation3D Point Cloud ClassificationFew-Shot 3D Point Cloud ClassificationRepresentation Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Part Segmentation ShapeNet-Part OTMae3D Class Average IoU 85.1 #12 of 67 Archive leaderboard report
3D Part Segmentation ShapeNet-Part OTMae3D Instance Average IoU 86.8 #12 of 67 Archive leaderboard report
3D Point Cloud Classification ModelNet40 OTMae3D Overall Accuracy 94.5 #13 of 111 Archive leaderboard report
3D Point Cloud Classification ModelNet40 OTMae3D (w/o Voting) Overall Accuracy 94.3 #16 of 111 Archive leaderboard report
3D Point Cloud Classification ScanObjectNN OTMae3D FLOPs 6.29 #31 of 77 Archive leaderboard report
3D Point Cloud Classification ScanObjectNN OTMae3D OBJ-BG (OA) 92.9 #31 of 77 Archive leaderboard report
3D Point Cloud Classification ScanObjectNN OTMae3D OBJ-ONLY (OA) 92.3 #31 of 77 Archive leaderboard report
3D Point Cloud Classification ScanObjectNN OTMae3D Overall Accuracy 89.0 #31 of 77 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 10-way (10-shot) OTMae3D Overall Accuracy 93.2 #11 of 31 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 10-way (10-shot) OTMae3D Standard Deviation 3.4 #11 of 31 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 10-way (20-shot) OTMae3D Overall Accuracy 95.6 #10 of 31 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 10-way (20-shot) OTMae3D Standard Deviation 2.6 #10 of 31 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 5-way (10-shot) OTMae3D Overall Accuracy 97.2 #10 of 30 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 5-way (10-shot) OTMae3D Standard Deviation 2.3 #10 of 30 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 5-way (20-shot) OTMae3D Overall Accuracy 98.7 #8 of 30 Archive leaderboard report
Few-Shot 3D Point Cloud Classification ModelNet40 5-way (20-shot) OTMae3D Standard Deviation 1.2 #8 of 30 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

AttentionSoftmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections