Papers › Learnable Prompt for Few-Shot Semantic Segmentation in Remote Sensing Domain

Learnable Prompt for Few-Shot Semantic Segmentation in Remote Sensing Domain

16 Apr 2024arXiv:2404.10307archive 2025-07-28

Steve Andreas Immanuel, Hagai Raja Sinulingga

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main challenge is how to train the model such that the addition of novel classes does not hurt the base classes performance, also known as catastrophic forgetting. To mitigate this issue, we use SegGPT as our base model and train it on the base classes. Then, we use separate learnable prompts to handle predictions for each novel class. To handle various object sizes which typically present in remote sensing domain, we perform patch-based prediction. To address the discontinuities along patch boundaries, we propose a patch-and-stitch technique by re-framing the problem as an image inpainting task. During inference, we also utilize image similarity search over image embeddings for prompt selection and novel class filtering to reduce false positive predictions. Based on our experiments, our proposed method boosts the weighted mIoU of a simple fine-tuned SegGPT from 15.96 to 35.08 on the validation set of few-shot OpenEarthMap dataset given in the challenge.

PaperPDFCode

Code

SteveImmanuel/OEM-Few-Shot-Learnable-Prompt officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot Semantic SegmentationImage InpaintingImage Similarity SearchSemantic Segmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

BASEInpaintingSET

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections