{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-content-enhanced-mask-transformer","title":"Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentation","arxiv_id":"2307.00371","date":"2023-07-01","proceeding":null,"authors":["Qi Bi","ShaoDi You","Theo Gevers"],"abstract":"Domain-generalized urban-scene semantic segmentation (USSS) aims to learn generalized semantic predictions across diverse urban-scene styles. Unlike domain gap challenges, USSS is unique in that the semantic categories are often similar in different urban scenes, while the styles can vary significantly due to changes in urban landscapes, weather conditions, lighting, and other factors. Existing approaches typically rely on convolutional neural networks (CNNs) to learn the content of urban scenes. In this paper, we propose a Content-enhanced Mask TransFormer (CMFormer) for domain-generalized USSS. The main idea is to enhance the focus of the fundamental component, the mask attention mechanism, in Transformer segmentation models on content information. To achieve this, we introduce a novel content-enhanced mask attention mechanism. It learns mask queries from both the image feature and its down-sampled counterpart, as lower-resolution image features usually contain more robust content information and are less sensitive to style variations. These features are fused into a Transformer decoder and integrated into a multi-resolution content-enhanced mask attention learning scheme. Extensive experiments conducted on various domain-generalized urban-scene segmentation datasets demonstrate that the proposed CMFormer significantly outperforms existing CNN-based methods for domain-generalized semantic segmentation, achieving improvements of up to 14.00\\% in terms of mIoU (mean intersection over union). The source code is publicly available at \\url{https://github.com/BiQiWHU/CMFormer}.","url_abs":"https://arxiv.org/abs/2307.00371v5","url_pdf":"https://arxiv.org/pdf/2307.00371v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-content-enhanced-mask-transformer","repo_url":"https://github.com/BiQiWHU/CMFormer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"domain-adaptation","task_name":"Domain Adaptation"},{"task_slug":"domain-generalization","task_name":"Domain Generalization"},{"task_slug":"scene-segmentation","task_name":"Scene Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"source-free-domain-adaptation","task_name":"Source-Free Domain Adaptation"},{"task_slug":"synthetic-to-real-translation","task_name":"Synthetic-to-Real Translation"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"focus","method_name":"Focus"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/domain-adaptation-on-cityscapes-to-acdc","task":"Domain Adaptation","dataset":"Cityscapes to ACDC","model":"CMFormer","rank_in_archive_order":10,"of":16,"metrics":{"mIoU":"60.1"},"uses_additional_data":false},{"leaderboard":"/sota/domain-generalization-on-gta-to-avg","task":"Domain Generalization","dataset":"GTA-to-Avg(Cityscapes,BDD,Mapillary)","model":"CMFormer","rank_in_archive_order":13,"of":24,"metrics":{"mIoU":"51.10"},"uses_additional_data":false},{"leaderboard":"/sota/domain-generalization-on-gta5-to-cityscapes","task":"Domain Generalization","dataset":"GTA5-to-Cityscapes","model":"CMFormer","rank_in_archive_order":6,"of":8,"metrics":{"mIoU":"55.31"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-gtav-to-cityscapes-1","task":"Semantic Segmentation","dataset":"GTAV-to-Cityscapes Labels","model":"CMFormer","rank_in_archive_order":11,"of":12,"metrics":{"mIoU":"55.3"},"uses_additional_data":false},{"leaderboard":"/sota/source-free-domain-adaptation-on-cityscapes","task":"Source-Free Domain Adaptation","dataset":"Cityscapes to ACDC","model":"CMFormer","rank_in_archive_order":2,"of":2,"metrics":{"mIoU":"60.1"},"uses_additional_data":false},{"leaderboard":"/sota/synthetic-to-real-translation-on-gtav-to","task":"Synthetic-to-Real Translation","dataset":"GTAV-to-Cityscapes Labels","model":"CMFormer","rank_in_archive_order":20,"of":73,"metrics":{"mIoU":"59.7"},"uses_additional_data":true},{"leaderboard":"/sota/synthetic-to-real-translation-on-synthia-to-2","task":"Synthetic-to-Real Translation","dataset":"SYNTHIA-to-Cityscapes Labels","model":"CMFormer","rank_in_archive_order":2,"of":2,"metrics":{"mIOU":"44.6"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.00371","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}