Papers › Automatic Synthetic Data and Fine-grained Adaptive Feature Alignment for Composed...

Automatic Synthetic Data and Fine-grained Adaptive Feature Alignment for Composed Person Retrieval

25 Nov 2023arXiv:2311.16515archive 2025-07-28

Delong Liu, Haiwen Li, Zhaohui Hou, Zhicheng Zhao, Fei Su, Yuan Dong

Person retrieval has attracted rising attention. Existing methods are mainly divided into two retrieval modes, namely image-only and text-only. However, they are unable to make full use of the available information and are difficult to meet diverse application requirements. To address the above limitations, we propose a new Composed Person Retrieval (CPR) task, which combines visual and textual queries to identify individuals of interest from large-scale person image databases. Nevertheless, the foremost difficulty of the CPR task is the lack of available annotated datasets. Therefore, we first introduce a scalable automatic data synthesis pipeline, which decomposes complex multimodal data generation into the creation of textual quadruples followed by identity-consistent image synthesis using fine-tuned generative models. Meanwhile, a multimodal filtering method is designed to ensure the resulting SynCPR dataset retains 1.15 million high-quality and fully synthetic triplets. Additionally, to improve the representation of composed person queries, we propose a novel Fine-grained Adaptive Feature Alignment (FAFA) framework through fine-grained dynamic alignment and masked feature reasoning. Moreover, for objective evaluation, we manually annotate the Image-Text Composed Person Retrieval (ITCPR) test set. The extensive experiments demonstrate the effectiveness of the SynCPR dataset and the superiority of the proposed FAFA framework when compared with the state-of-the-art methods. All code and data will be provided at https://github.com/Delong-liu-bupt/Composed_Person_Retrieval.

PaperPDFCode

Code

Delong-liu-bupt/Word4Per officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image GenerationPerson RetrievalRetrievalText based Person RetrievalText-based Person RetrievalZero-shot Composed Person Retrieval

Datasets

Introduced by this paper, per the archive.

ITCPR dataset

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Zero-shot Composed Person Retrieval ITCPR dataset FAFA Rank-1 46.54 #1 of 2 Archive leaderboard report
Zero-shot Composed Person Retrieval ITCPR dataset FAFA mAP 55.60 #1 of 2 Archive leaderboard report
Zero-shot Composed Person Retrieval ITCPR dataset Word4Per(FAFA old version) Rank-1 45.55 #2 of 2 Archive leaderboard report
Zero-shot Composed Person Retrieval ITCPR dataset Word4Per(FAFA old version) mAP 55.26 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections