Papers › Cross-Domain Semantic Segmentation on Inconsistent Taxonomy using VLMs
Cross-Domain Semantic Segmentation on Inconsistent Taxonomy using VLMs
Jeongkee Lim, Yusung Kim
The challenge of semantic segmentation in Unsupervised Domain Adaptation (UDA) emerges not only from domain shifts between source and target images but also from discrepancies in class taxonomies across domains. Traditional UDA research assumes consistent taxonomy between the source and target domains, thereby limiting their ability to recognize and adapt to the taxonomy of the target domain. This paper introduces a novel approach, Cross-Domain Semantic Segmentation on Inconsistent Taxonomy using Vision Language Models (CSI), which effectively performs domain-adaptive semantic segmentation even in situations of source-target class mismatches. CSI leverages the semantic generalization potential of Visual Language Models (VLMs) to create synergy with previous UDA methods. It leverages segment reasoning obtained through traditional UDA methods, combined with the rich semantic knowledge embedded in VLMs, to relabel new classes in the target domain. This approach allows for effective adaptation to extended taxonomies without requiring any ground truth label for the target domain. Our method has shown to be effective across various benchmarks in situations of inconsistent taxonomy settings (coarse-to-fine taxonomy and open taxonomy) and demonstrates consistent synergy effects when integrated with previous state-of-the-art UDA methods. The implementation is available at http://github.com/jkee58/CSI.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Unsupervised Domain Adaptation | SYNTHIA-to-Cityscapes | MIC+CSI | mIoU | 68.8 | #2 of 23 | Archive leaderboard | report |
| Unsupervised Domain Adaptation | SYNTHIA-to-Cityscapes | MIC+CSI | mIoU (13 classes) | 75.9 | #2 of 23 | Archive leaderboard | report |
| Unsupervised Domain Adaptation | SYNTHIA-to-Cityscapes | MIC+CSI | mIoU (19 classes) | 67.4 | #2 of 23 | Archive leaderboard | report |
| Unsupervised Domain Adaptation | SYNTHIA-to-Cityscapes | DAFormer+CSI | mIoU | 61.4 | #23 of 23 | Archive leaderboard | report |
| Unsupervised Domain Adaptation | SYNTHIA-to-Cityscapes | DAFormer+CSI | mIoU (19 classes) | 60 | #23 of 23 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections