Browse State-of-the-Art › 3D Semantic Scene Completion
3D Semantic Scene Completion
34 papers with code · 4 benchmarks · 5 datasets archive 2025-07-28
This task was introduced in "Semantic Scene Completion from a Single Depth Image" (https://arxiv.org/abs/1611.08974) at CVPR 2017 . The target is to infer the dense 3D voxelized semantic scene from an incompleted 3D input (e.g. point cloud, depth map) and an optional RGB image. A recent summary can be found in the paper "3D Semantic Scene Completion: a Survey" (https://arxiv.org/abs/2103.07466), published at IJCV 2021.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| NYUv2 (28 rows) | SG-SSC | 2D Semantic-Guided Semantic Scene Completion | code | — | Compare |
| SemanticKITTI (20 rows) | TALoS | TALoS: Enhancing Semantic Scene Completion via Test-time... | code | Syntology ran 6 of 17 samples · 11 unverified | Compare |
| KITTI-360 (7 rows) | Symphonies | Symphonize 3D Semantic Scene Completion with Contextual Instance Queries | code | Syntology ran 1 of 8 samples · 7 unverified | Compare |
| PRO-teXt (4 rows) | LSDM | — | — | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
5 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Most implemented papers archive 2025-07-28
30 shown of 34 papers with code (65 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.
-
15 Feb 2023 3 repositories listed Syntology ran 3 of 4 samples · 1 unverifiedTo lift image features to the 3D TPV space, we further propose a transformer-based TPV encoder (TPVFormer) to obtain the TPV features effectively.
-
24 Aug 2020 3 repositories listedWe introduce a new approach for multiscale 3Dsemantic scene completion from voxelized sparse 3D LiDAR scans.
-
28 Nov 2016 3 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)This paper focuses on semantic scene completion, a task for producing a complete 3D voxel representation of volumetric occupancy and semantic labels for a scene from a single-view depth map observation.
-
1 Dec 2021 2 repositories listed Syntology ran 3 of 6 samples · 3 unverifiedMonoScene proposes a 3D Semantic Scene Completion (SSC) framework, where the dense geometry and semantics of a scene are inferred from a single monocular RGB image.
-
7 Dec 2020 2 repositories listedIn practice, an initial semantic segmentation (SS) of a single sweep point cloud can be achieved by any appealing network and then flows into the semantic scene completion (SSC) module as the input.
-
26 Oct 2020 2 repositories listed Syntology ran 0 of 7 samples · 7 unverifiedWe propose a framework that ameliorates this issue by performing scene reconstruction and semantic scene completion jointly in an incremental and real-time manner, based on an input sequence of depth maps.
-
31 Mar 2020 2 repositories listed Syntology ran 1 of 3 samples · 2 unverifiedTo this end, we first propose a novel 3D sketch-aware feature embedding to explicitly encode geometric information effectively and efficiently.
-
11 Jul 2025 1 repository listed Syntology ran 1 of 8 samples · 7 unverified · 8 pointer-only (licence)3D Semantic Scene Completion (SSC) has gained increasing attention due to its pivotal role in 3D perception.
-
Camera-Only 3D Panoptic Scene Completion for Autonomous Driving through Differentiable Object Shapes14 May 2025 1 repository listedThis has sparked research into the tasks of 3D occupancy prediction, 3D scene completion, and 3D panoptic scene completion, which predict a dense map of the ego vehicle's surroundings as a voxel grid.
-
21 Mar 2025 1 repository listedRecently, camera-based solutions have been extensively explored for scene semantic completion (SSC).
-
8 Mar 2025 1 repository listedTo address these challenges, we propose a novel method VLScene: Vision-Language Guidance Distillation for Camera-based 3D Semantic Scene Completion.
-
13 Jan 2025 1 repository listedWe propose a unique neural model, leveraging advances from the state space and diffusion generative modeling to achieve remarkable 3D semantic scene completion performance with monocular image input.
-
1 Jan 2025 1 repository listedExisting view transformations in vision-centric 3D Semantic Scene Completion (SSC) inevitably experience erroneous feature duplication in the reconstructed voxel space due to occlusions, leading to a dilution of…
-
21 Oct 2024 1 repository listed Syntology ran 6 of 17 samples · 11 unverified · 17 pointer-only (licence)Semantic Scene Completion (SSC) aims to perform geometric completion and semantic segmentation simultaneously.
-
12 Sep 2024 1 repository listedSemantic scene completion (SSC) aims to simultaneously perform scene completion (SC) and predict semantic categories of a 3D scene from a single depth and/or RGB image.
-
2 Jul 2024 1 repository listedTo address this problem, we present HTCL, a novel Hierarchical Temporal Context Learning paradigm for improving camera-based semantic scene completion.
-
13 Mar 2024 1 repository listedPrevious methods, confined to onboard processing, struggle with simultaneous geometric and semantic estimation, continuity across varying viewpoints, and single-view occlusion.
-
10 Dec 2023 1 repository listed Syntology ran 3 of 8 samples · 5 unverified · 8 pointer-only (licence)In this paper, we adopt the dense-sparse-dense design and propose a one-stage camera-based SSC framework, termed SGN, to propagate semantics from the semantic-aware seed voxels to the whole scene based on spatial…
-
26 Sep 2023 1 repository listed Syntology ran 5 of 7 samples · 2 unverified · 7 pointer-only (licence)Monocular 3D Semantic Scene Completion (SSC) has garnered significant attention in recent years due to its potential to predict complex semantics and geometry shapes from a single image, requiring no 3D inputs.
-
27 Jun 2023 1 repository listed Syntology ran 1 of 8 samples · 7 unverified`3D Semantic Scene Completion (SSC) has emerged as a nascent and pivotal undertaking in autonomous driving, aiming to predict voxel occupancy within volumetric scenes.
-
15 Jun 2023 1 repository listedMonocular scene understanding is a foundational component of autonomous systems.
-
11 Apr 2023 1 repository listed Syntology ran 1 of 3 samples · 2 unverifiedThe vision-based perception for autonomous driving has undergone a transformation from the bird-eye-view (BEV) representations to the 3D semantic occupancy.
-
24 Mar 2023 1 repository listed Syntology ran 0 of 1 samples · 1 unverifiedHowever, due to the inherent representation gap between stereo geometry and BEV features, it is non-trivial to bridge them for dense prediction task of SSC.
-
13 Mar 2023 1 repository listedWe propose a simple yet effective label rectification strategy, which uses off-the-shelf panoptic segmentation labels to remove the traces of dynamic objects in completion labels, greatly improving the performance of…
-
27 Feb 2023 1 repository listed Syntology ran 3 of 6 samples · 3 unverified3D Semantic Scene Completion (SSC) can provide dense geometric and semantic scene representations, which can be applied in the field of autonomous driving and robotic systems.
-
23 Feb 2023 1 repository listedTo enable such capability in AI systems, we propose VoxFormer, a Transformer-based semantic scene completion framework that can output complete 3D volumetric semantics from only 2D images.
-
26 Nov 2021 1 repository listedIn this paper, we introduce the use of a 3D data augmentation strategy that can be applied to multimodal SSC networks.
-
7 Oct 2021 1 repository listedThe ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation.
-
23 Sep 2021 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)Specifically, the network takes a raw point cloud as input, and merges the features from the segmentation branch into the completion branch hierarchically to provide semantic information.
-
8 Apr 2021 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)The key insight is that we decouple the instances from a coarsely completed semantic scene instead of a raw input image to guide the reconstruction of instances and the overall scene.
Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections