Papers › Variational Context-Deformable ConvNets for Indoor Scene Parsing
Variational Context-Deformable ConvNets for Indoor Scene Parsing
Zhitong Xiong, Yuan Yuan, Nianhui Guo, Qi Wang
Context information is critical for image semantic segmentation. Especially in indoor scenes, the large variation of object scales makes spatial-context an important factor for improving the segmentation performance. Thus, in this paper, we propose a novel variational context-deformable (VCD) module to learn adaptive receptive-field in a structured fashion. Different from standard ConvNets, which share fixed-size spatial context for all pixels, the VCD module learns a deformable spatial-context with the guidance of depth information: depth information provides clues for identifying real local neighborhoods. Specifically, adaptive Gaussian kernels are learned with the guidance of multimodal information. By multiplying the learned Gaussian kernel with standard convolution filters, the VCD module can aggregate flexible spatial context for each pixel during convolution. The main contributions of this work are as follows: 1) a novel VCD module is proposed, which exploits learnable Gaussian kernels to enable feature learning with structured adaptive-context; 2) variational Bayesian probabilistic modeling is introduced for the training of VCD module, which can make it continuous and more stable; 3) a perspective-aware guidance module is designed to take advantage of multi-modal information for RGB-D segmentation. We evaluate the proposed approach on three widely-used datasets, and the performance improvement has shown the effectiveness of the proposed method.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Scene Parsing | Cityscapes test | VCD No Coarse | mIoU | 82.3 | #1 of 1 | Archive leaderboard | report |
| Semantic Segmentation | GAMUS | VCD | mIoU | 59.70 | #3 of 6 | Archive leaderboard | report |
| Semantic Segmentation | NYU Depth v2 | VCD+ACNet (ResNet-50) | Mean IoU | 51.9% | #48 of 121 | Archive leaderboard | report |
| Semantic Segmentation | NYU Depth v2 | VCD+RedNet (ResNet-50) | Mean IoU | 50.7% | #61 of 121 | Archive leaderboard | report |
| Semantic Segmentation | NYU Depth v2 | VCD+DeepLab (VGG16) | Mean IoU | 45.3 | #93 of 121 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections