Papers › An Empirical Study of CLIP for Text-based Person Search

An Empirical Study of CLIP for Text-based Person Search

19 Aug 2023arXiv:2308.10045archive 2025-07-28

Min Cao, Yang Bai, Ziyin Zeng, Mang Ye, Min Zhang

Text-based Person Search (TBPS) aims to retrieve the person images using natural language descriptions. Recently, Contrastive Language Image Pretraining (CLIP), a universal large cross-modal vision-language pre-training model, has remarkably performed over various cross-modal downstream tasks due to its powerful cross-modal semantic learning capacity. TPBS, as a fine-grained cross-modal retrieval task, is also facing the rise of research on the CLIP-based TBPS. In order to explore the potential of the visual-language pre-training model for downstream TBPS tasks, this paper makes the first attempt to conduct a comprehensive empirical study of CLIP for TBPS and thus contribute a straightforward, incremental, yet strong TBPS-CLIP baseline to the TBPS community. We revisit critical design considerations under CLIP, including data augmentation and loss function. The model, with the aforementioned designs and practical training tricks, can attain satisfactory performance without any sophisticated modules. Also, we conduct the probing experiments of TBPS-CLIP in model generalization and model compression, demonstrating the effectiveness of TBPS-CLIP from various aspects. This work is expected to provide empirical insights and highlight future CLIP-based TBPS research.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

flame-chasers/tbps-clip officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cross-Modal RetrievalData AugmentationModel CompressionPerson SearchRetrievalText based Person RetrievalText based Person Search

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Text based Person Retrieval ICFG-PEDES TBPS-CLIP (ViT-B/16) R@1 65.05 #6 of 12 Archive leaderboard report
Text based Person Retrieval ICFG-PEDES TBPS-CLIP (ViT-B/16) R@10 85.47 #6 of 12 Archive leaderboard report
Text based Person Retrieval ICFG-PEDES TBPS-CLIP (ViT-B/16) R@5 80.34 #6 of 12 Archive leaderboard report
Text based Person Retrieval ICFG-PEDES TBPS-CLIP (ViT-B/16) mAP 39.83 #6 of 12 Archive leaderboard report
Text based Person Retrieval RSTPReid TBPS-CLIP (ViT-B/16) R@1 61.95 #6 of 9 Archive leaderboard report
Text based Person Retrieval RSTPReid TBPS-CLIP (ViT-B/16) R@10 88.75 #6 of 9 Archive leaderboard report
Text based Person Retrieval RSTPReid TBPS-CLIP (ViT-B/16) R@5 83.55 #6 of 9 Archive leaderboard report
Text based Person Retrieval RSTPReid TBPS-CLIP (ViT-B/16) mAP 48.26 #6 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

CLIP

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections