Papers › LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels

LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels

22 Mar 2024CVPR 2024 1arXiv:2403.15173archive 2025-07-28

Tuo Feng, Wenguan Wang, Fan Ma, Yi Yang

Autonomous systems need to process large-scale, sparse, and irregular point clouds with limited compute resources. Consequently, it is essential to develop LiDAR perception methods that are both efficient and effective. Although naively enlarging 3D kernel size can enhance performance, it will also lead to a cubically-increasing overhead. Therefore, it is crucial to develop streamlined 3D large kernel designs that eliminate redundant weights and work effectively with larger kernels. In this paper, we propose an efficient and effective Large Sparse Kernel 3D Neural Network (LSK3DNet) that leverages dynamic pruning to amplify the 3D kernel size. Our method comprises two core components: Spatial-wise Dynamic Sparsity (SDS) and Channel-wise Weight Selection (CWS). SDS dynamically prunes and regrows volumetric weights from the beginning to learn a large sparse 3D kernel. It not only boosts performance but also significantly reduces model size and computational cost. Moreover, CWS selects the most important channels for 3D convolution during training and subsequently prunes the redundant channels to accelerate inference for 3D vision tasks. We demonstrate the effectiveness of LSK3DNet on three benchmark datasets and five tracks compared with classical models and large kernel designs. Notably, LSK3DNet achieves the state-of-the-art performance on SemanticKITTI (i.e., 75.6% on single-scan and 63.4% on multi-scan), with roughly 40% model size reduction and 60% computing operations reduction compared to the naive large 3D kernel model.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

fengzicai/lsk3dnet officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Semantic SegmentationLIDAR Semantic SegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Semantic Segmentation ScanNet200 LSK3DNet val mIoU 33.1 #9 of 16 Archive leaderboard report
3D Semantic Segmentation SemanticKITTI LSK3DNet test mIoU 75.6% #1 of 45 Archive leaderboard report
3D Semantic Segmentation SemanticKITTI LSK3DNet val mIoU 70.2% #1 of 45 Archive leaderboard report
LIDAR Semantic Segmentation nuScenes LSK3DNet val mIoU 0.801 #32 of 36 Archive leaderboard report
Semantic Segmentation ScanNet LSK3DNet test mIoU 75.5 #18 of 45 Archive leaderboard report
Semantic Segmentation ScanNet LSK3DNet val mIoU 75.7 #18 of 45 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

3D ConvolutionConvolutionPruning

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections