Papers › FarSeg++: Foreground-Aware Relation Network for Geospatial Object Segmentation in High...

FarSeg++: Foreground-Aware Relation Network for Geospatial Object Segmentation in High Spatial Resolution Remote Sensing Imagery

13 Jul 2023IEEE Transactions on Pattern Analysis and Machine Intelligence 2023 7archive 2025-07-28

Zhuo Zheng, Yanfei Zhong, Junjue Wang, Ailong Ma, Liangpei Zhang

Geospatial object segmentation, a fundamental Earth vision task, always suffers from scale variation, the larger intraclass variance of background, and foreground-background imbalance in high spatial resolution (HSR) remote sensing imagery. Generic semantic segmentation methods mainly focus on the scale variation in natural scenarios. However, the other two problems are insufficiently considered in large area Earth observation scenarios. In this paper, we propose a foreground-aware relation network (FarSeg++) from the perspectives of relation-based, optimizationbased, and objectness-based foreground modeling, alleviating the above two problems. From the perspective of the relations, the foreground-scene relation module improves the discrimination of the foreground features via the foreground-correlated contexts associated with the object-scene relation. From the perspective of optimization, foreground-aware optimization is proposed to focus on foreground examples and hard examples of the background during training to achieve a balanced optimization. Besides, from the perspective of objectness, a foreground-aware decoder is proposed to improve the objectness representation, alleviating the objectness prediction problem that is the main bottleneck revealed by an empirical upper bound analysis. We also introduce a new large-scale high-resolution urban vehicle segmentation dataset to verify the effectiveness of the proposed method and push the development of objectness prediction further forward. The experimental results suggest that FarSeg++ is superior to the state-of-the-art generic semantic segmentation methods and can achieve a better trade-off between speed and accuracy.

PaperPDFCode

Code

Z-Zheng/FarSeg officialpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Earth ObservationRelation NetworkSegmentationSemantic SegmentationThe Semantic Segmentation Of Remote Sensing Imagery

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semantic Segmentation iSAID FarSeg++@MiT-B2 mIoU 67.9 #7 of 19 Archive leaderboard report
Semantic Segmentation iSAID FarSeg++@ResNet-50 mIoU 67.6 #8 of 19 Archive leaderboard report
Semantic Segmentation iSAID FarSeg++@Swin-T mIoU 66.3 #11 of 19 Archive leaderboard report
The Semantic Segmentation Of Remote Sensing Imagery UV6K FarSeg++@MiT-B2 IoU (%) 66.4 #1 of 3 Archive leaderboard report
The Semantic Segmentation Of Remote Sensing Imagery UV6K FarSeg++@Swin-T IoU (%) 65.8 #2 of 3 Archive leaderboard report
The Semantic Segmentation Of Remote Sensing Imagery UV6K FarSeg++@ResNet-50 IoU (%) 64.4 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionFocusSPEED

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections