Papers › FewVS: A Vision-Semantics Integration Framework for Few-Shot Image Classification

FewVS: A Vision-Semantics Integration Framework for Few-Shot Image Classification

28 Oct 2024Proceedings of the 32nd ACM International Conference on Multimedia 2024 10archive 2025-07-28

Zhuoling Li, Yong Wang, Kaitong Li

Some recent methods address few-shot image classification by extracting semantic information from class names and devising mechanisms for aligning vision and semantics to integrate information from both modalities. However, class names provide only limited information, which is insufficient to capture the visual details in images. As a result, such vision-semantics alignment is inherently biased, leading to suboptimal integration outcomes. In this paper, we avoid such biased vision-semantics alignment by introducing CLIP, a natural bridge between vision and semantics, and enforcing unbiased vision-vision alignment as a proxy task. Specifically, we align features encoded from the few-shot encoder and CLIP's vision encoder on the same image. This alignment is accomplished through a linear projection layer, with a training objective formulated using optimal transport-based assignment prediction. Thanks to...

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot Image ClassificationFew-Shot LearningImage Classificationimage-classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

ALIGNCLIP

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections