Papers › Open-Vocabulary Semantic Segmentation with Decoupled One-Pass Network

Open-Vocabulary Semantic Segmentation with Decoupled One-Pass Network

3 Apr 2023ICCV 2023 1arXiv:2304.01198archive 2025-07-28

Cong Han, Yujie Zhong, Dengjie Li, Kai Han, Lin Ma

Recently, the open-vocabulary semantic segmentation problem has attracted increasing attention and the best performing methods are based on two-stream networks: one stream for proposal mask generation and the other for segment classification using a pretrained visual-language model. However, existing two-stream methods require passing a great number of (up to a hundred) image crops into the visual-language model, which is highly inefficient. To address the problem, we propose a network that only needs a single pass through the visual-language model for each input image. Specifically, we first propose a novel network adaptation approach, termed patch severance, to restrict the harmful interference between the patch embeddings in the pre-trained visual encoder. We then propose classification anchor learning to encourage the network to spatially focus on more discriminative features for classification. Extensive experiments demonstrate that the proposed method achieves outstanding performance, surpassing state-of-the-art methods while being 4 to 7 times faster at inference. Code: https://github.com/CongHan0808/DeOP.git

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

conghan0808/deop officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClassificationLanguage ModelingLanguage ModellingOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSemantic SegmentationZero-Shot Semantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Zero-Shot Semantic Segmentation COCO-Stuff DeOP Inductive Setting hIoU 38.2 #13 of 15 Archive leaderboard report
Zero-Shot Semantic Segmentation COCO-Stuff DeOP Transductive Setting hIoU - #13 of 15 Archive leaderboard report
Zero-Shot Semantic Segmentation PASCAL VOC DeOp Inductive Setting hIoU 80.8 #12 of 13 Archive leaderboard report
Zero-Shot Semantic Segmentation PASCAL VOC DeOp Transductive Setting hIoU - #12 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections