Papers › DifFSS: Diffusion Model for Few-Shot Semantic Segmentation
DifFSS: Diffusion Model for Few-Shot Semantic Segmentation
Weimin Tan, Siyuan Chen, Bo Yan
Diffusion models have demonstrated excellent performance in image generation. Although various few-shot semantic segmentation (FSS) models with different network structures have been proposed, performance improvement has reached a bottleneck. This paper presents the first work to leverage the diffusion model for FSS task, called DifFSS. DifFSS, a novel FSS paradigm, can further improve the performance of the state-of-the-art FSS models by a large margin without modifying their network structure. Specifically, we utilize the powerful generation ability of diffusion models to generate diverse auxiliary support images by using the semantic mask, scribble or soft HED boundary of the support image as control conditions. This generation process simulates the variety within the class of the query image, such as color, texture variation, lighting, etc. As a result, FSS models can refer to more diverse support images, yielding more robust representations, thereby achieving a consistent improvement in segmentation performance. Extensive experiments on three publicly available datasets based on existing advanced FSS models demonstrate the effectiveness of the diffusion model for FSS task. Furthermore, we explore in detail the impact of different input settings of the diffusion model on segmentation performance. Hopefully, this completely new paradigm will bring inspiration to the study of FSS task integrated with AI-generated content. Code is available at https://github.com/TrinitialChan/DifFSS
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | HDMNet (DifFSS, ResNet-50) | Mean IoU | 46.7 | #23 of 85 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | BAM (DifFSS, ResNet-50) | Mean IoU | 43.6 | #41 of 85 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | FSS-1000 (1-shot) | DCAMA (DifFSS, ResNet-50) | Mean IoU | 88.4 | #10 of 24 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | FSS-1000 (1-shot) | HSNet (DifFSS, ResNet-50) | Mean IoU | 86.2 | #18 of 24 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | HDMNet (DifFSS, ResNet-50) | Mean IoU | 70.2 | #8 of 105 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | BAM (DifFSS, ResNet-50) | Mean IoU | 69.3 | #12 of 105 | Archive leaderboard | report |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | CyCTR (DifFSS, ResNet-50) | Mean IoU | 66.2 | #40 of 105 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections