Papers › Channelized Axial Attention for Semantic Segmentation -- Considering Channel Relation...

Channelized Axial Attention for Semantic Segmentation -- Considering Channel Relation within Spatial Attention for Semantic Segmentation

19 Jan 2021arXiv:2101.07434archive 2025-07-28

Ye Huang, Di Kang, Wenjing Jia, Xiangjian He, Liu Liu

Spatial and channel attentions, modelling the semantic interdependencies in spatial and channel dimensions respectively, have recently been widely used for semantic segmentation. However, computing spatial and channel attentions separately sometimes causes errors, especially for those difficult cases. In this paper, we propose Channelized Axial Attention (CAA) to seamlessly integrate channel attention and spatial attention into a single operation with negligible computation overhead. Specifically, we break down the dot-product operation of the spatial attention into two parts and insert channel relation in between, allowing for independently optimized channel attention on each spatial location. We further develop grouped vectorization, which allows our model to run with very little memory consumption without slowing down the running speed. Comparative experiments conducted on multiple benchmark datasets, including Cityscapes, PASCAL Context, and COCO-Stuff, demonstrate that our CAA outperforms many state-of-the-art segmentation models (including dual attention) on all tested datasets.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

SegmentationSemantic Segmentation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semantic Segmentation COCO-Stuff test CAA (Efficientnet-B7) mIoU 45.4% #8 of 21 Archive leaderboard report
Semantic Segmentation COCO-Stuff test CAA (ResNet-101) mIoU 41.2% #11 of 21 Archive leaderboard report
Semantic Segmentation Cityscapes test CAA (ResNet-101) Mean IoU (class) 82.6% #26 of 105 Archive leaderboard report
Semantic Segmentation PASCAL Context CAA + Simple decoder (Efficientnet-B7) mIoU 60.5 #12 of 66 Archive leaderboard report
Semantic Segmentation PASCAL Context CAA (Efficientnet-B7) mIoU 60.1 #14 of 66 Archive leaderboard report
Semantic Segmentation PASCAL Context CAA (ResNet-101) mIoU 55.0 #32 of 66 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Axial Attention

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections