Papers › CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without...

CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels

25 Nov 2022arXiv:2211.13977archive 2025-07-28

Siyuan Li, Li Sun, Qingli Li

Pre-trained vision-language models like CLIP have recently shown superior performances on various downstream tasks, including image classification and segmentation. However, in fine-grained image re-identification (ReID), the labels are indexes, lacking concrete text descriptions. Therefore, it remains to be determined how such models could be applied to these tasks. This paper first finds out that simply fine-tuning the visual model initialized by the image encoder in CLIP, has already obtained competitive performances in various ReID tasks. Then we propose a two-stage strategy to facilitate a better visual representation. The key idea is to fully exploit the cross-modal description ability in CLIP through a set of learnable text tokens for each ID and give them to the text encoder to form ambiguous descriptions. In the first training stage, image and text encoders from CLIP keep fixed, and only the text tokens are optimized from scratch by the contrastive loss computed within a batch. In the second stage, the ID-specific text tokens and their encoder become static, providing constraints for fine-tuning the image encoder. With the help of the designed loss in the downstream task, the image encoder is able to represent data as vectors in the feature embedding accurately. The effectiveness of the proposed strategy is validated on several datasets for the person or vehicle ReID tasks. Code is available at https://github.com/Syliz517/CLIP-ReID.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

syliz517/clip-reid officialmentioned in papermentioned on GitHubpytorchMIT report
mikel-brostrom/boxmot mentioned on GitHubpytorchAGPL-3.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image ClassificationLanguage ModelingLanguage ModellingPerson Re-IdentificationVehicle Re-Identificationimage-classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Person Re-Identification DukeMTMC-reID CLIP-ReID (without re-ranking) Rank-1 90.8 #28 of 94 Archive leaderboard report
Person Re-Identification DukeMTMC-reID CLIP-ReID (without re-ranking) mAP 83.1 #28 of 94 Archive leaderboard report
Person Re-Identification MSMT17 CLIP-ReID (with re-ranking) Rank-1 91.2 #1 of 43 Archive leaderboard report
Person Re-Identification MSMT17 CLIP-ReID (with re-ranking) mAP 86.7 #1 of 43 Archive leaderboard report
Person Re-Identification MSMT17 CLIP-ReID (without re-ranking) Rank-1 89.7 #9 of 43 Archive leaderboard report
Person Re-Identification MSMT17 CLIP-ReID (without re-ranking) mAP 75.8 #9 of 43 Archive leaderboard report
Person Re-Identification Market-1501 CLIP-ReID (without re-ranking) Rank-1 95.4 #61 of 135 Archive leaderboard report
Person Re-Identification Market-1501 CLIP-ReID (without re-ranking) mAP 90.5 #61 of 135 Archive leaderboard report
Vehicle Re-Identification VeRi-776 CLIP-ReID (without re-ranking) Rank-1 97.3 #6 of 17 Archive leaderboard report
Vehicle Re-Identification VeRi-776 CLIP-ReID (without re-ranking) mAP 84.5 #6 of 17 Archive leaderboard report
Vehicle Re-Identification VehicleID Small CLIP-ReID (without re-ranking) Rank-1 85.5 #8 of 13 Archive leaderboard report
Vehicle Re-Identification VehicleID Small CLIP-ReID (without re-ranking) Rank-5 97.2 #8 of 13 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

CLIP

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections