Papers › S²-FPN: Scale-ware Strip Attention Guided Feature Pyramid Network for Real-time...

S²-FPN: Scale-ware Strip Attention Guided Feature Pyramid Network for Real-time Semantic Segmentation

15 Jun 2022arXiv:2206.07298archive 2025-07-28

Mohammed A. M. Elhassan, Chenhui Yang, Chenxi Huang, Tewodros Legesse Munea, Xin Hong, Abuzar B. M. Adam, Amina Benabid

Modern high-performance semantic segmentation methods employ a heavy backbone and dilated convolution to extract the relevant feature. Although extracting features with both contextual and semantic information is critical for the segmentation tasks, it brings a memory footprint and high computation cost for real-time applications. This paper presents a new model to achieve a trade-off between accuracy/speed for real-time road scene semantic segmentation. Specifically, we proposed a lightweight model named Scale-aware Strip Attention Guided Feature Pyramid Network (S²-FPN). Our network consists of three main modules: Attention Pyramid Fusion (APF) module, Scale-aware Strip Attention Module (SSAM), and Global Feature Upsample (GFU) module. APF adopts an attention mechanisms to learn discriminative multi-scale features and help close the semantic gap between different levels. APF uses the scale-aware attention to encode global context with vertical stripping operation and models the long-range dependencies, which helps relate pixels with similar semantic label. In addition, APF employs channel-wise reweighting block (CRB) to emphasize the channel features. Finally, the decoder of S²-FPN then adopts GFU, which is used to fuse features from APF and the encoder. Extensive experiments have been conducted on two challenging semantic segmentation benchmarks, which demonstrate that our approach achieves better accuracy/speed trade-off with different model settings. The proposed models have achieved a results of 76.2\%mIoU/87.3FPS, 77.4\%mIoU/67FPS, and 77.8\%mIoU/30.5FPS on Cityscapes dataset, and 69.6\%mIoU,71.0\% mIoU, and 74.2\% mIoU on Camvid dataset. The code for this work will be made available at \url{https://github.com/mohamedac29/S2-FPN

PaperPDFCode

Code

mohamedac29/s2-fpn officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

2D Semantic SegmentationReal-Time Semantic SegmentationSegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Real-Time Semantic Segmentation CamVid S^2-FPN34M mIoU 74.2 #14 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid S^2-FPN34 Frame (fps) 107.2 #20 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid S^2-FPN34 mIoU 71.0 #20 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid S^2-FPN18 Frame (fps) 124.2 #21 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid S^2-FPN18 mIoU 69.5 #21 of 29 Archive leaderboard report
Real-Time Semantic Segmentation Cityscapes S^2-FPN34 mIoU 77.4 #1 of 2 Archive leaderboard report
Real-Time Semantic Segmentation Cityscapes S^2-FPN18 mIoU 76.2 #2 of 2 Archive leaderboard report
Semantic Segmentation Cityscapes SPFNet34M mIoU 77.8 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionDilated Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections