Papers › Feature-Proxy Transformer for Few-Shot Segmentation
Feature-Proxy Transformer for Few-Shot Segmentation
Jian-Wei Zhang, Yifan Sun, Yi Yang, Wei Chen
Few-shot segmentation (FSS) aims at performing semantic segmentation on novel classes given a few annotated support samples. With a rethink of recent advances, we find that the current FSS framework has deviated far from the supervised segmentation framework: Given the deep features, FSS methods typically use an intricate decoder to perform sophisticated pixel-wise matching, while the supervised segmentation methods use a simple linear classification head. Due to the intricacy of the decoder and its matching pipeline, it is not easy to follow such an FSS framework. This paper revives the straightforward framework of "feature extractor + linear classification head" and proposes a novel Feature-Proxy Transformer (FPTrans) method, in which the "proxy" is the vector representing a semantic class in the linear classification head. FPTrans has two keypoints for learning discriminative features and representative proxies: 1) To better utilize the limited support samples, the feature extractor makes the query interact with the support features from the bottom to top layers using a novel prompting strategy. 2) FPTrans uses multiple local background proxies (instead of a single one) because the background is not homogeneous and may contain some novel foreground regions. These two keypoints are easily integrated into the vision transformer backbone with the prompting mechanism in the transformer. Given the learned features and proxies, FPTrans directly compares their cosine similarity for segmentation. Although the framework is straightforward, we show that FPTrans achieves competitive FSS accuracy on par with state-of-the-art decoder-based methods.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | FPTrans (DeiT-B/16) | Mean IoU | 47 | #20 of 85 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | FPTrans (ViT-B/16) | Mean IoU | 42 | #52 of 85 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i (5-shot) | FPTrans (DeiT-B/16) | Mean IoU | 58.9 | #7 of 81 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i (5-shot) | FPTrans (ViT-B/16) | Mean IoU | 53.8 | #23 of 81 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i -> Pascal VOC (1-shot) | FPTrans (DeiT-B/16) | Mean IoU | 69.7 | #4 of 13 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i -> Pascal VOC (1-shot) | FPTrans (ViT-B/16) | Mean IoU | 67.6 | #7 of 13 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i -> Pascal VOC (5-shot) | FPTrans (DeiT-B/16) | Mean IoU | 79.3 | #1 of 12 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i -> Pascal VOC (5-shot) | FPTrans (ViT-B/16) | Mean IoU | 76.9 | #4 of 12 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | FPTrans (DeiT-B/16) | Mean IoU | 68.8 | #16 of 105 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | FPTrans (ViT-B/16) | Mean IoU | 64.7 | #55 of 105 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (5-Shot) | FPTrans (DeiT-B/16) | Mean IoU | 78 | #4 of 96 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (5-Shot) | FPTrans (ViT-B/16) | Mean IoU | 73.7 | #12 of 96 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections