{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dc-former-diverse-and-compact-transformer-for","title":"DC-Former: Diverse and Compact Transformer for Person Re-Identification","arxiv_id":"2302.14335","date":"2023-02-28","proceeding":null,"authors":["Wen Li","Cheng Zou","Meng Wang","Furong Xu","Jianan Zhao","Ruobing Zheng","Yuan Cheng","Wei Chu"],"abstract":"In person re-identification (re-ID) task, it is still challenging to learn discriminative representation by deep learning, due to limited data. Generally speaking, the model will get better performance when increasing the amount of data. The addition of similar classes strengthens the ability of the classifier to identify similar identities, thereby improving the discrimination of representation. In this paper, we propose a Diverse and Compact Transformer (DC-Former) that can achieve a similar effect by splitting embedding space into multiple diverse and compact subspaces. Compact embedding subspace helps model learn more robust and discriminative embedding to identify similar classes. And the fusion of these diverse embeddings containing more fine-grained information can further improve the effect of re-ID. Specifically, multiple class tokens are used in vision transformer to represent multiple embedding spaces. Then, a self-diverse constraint (SDC) is applied to these spaces to push them away from each other, which makes each embedding space diverse and compact. Further, a dynamic weight controller(DWC) is further designed for balancing the relative importance among them during training. The experimental results of our method are promising, which surpass previous state-of-the-art methods on several commonly used person re-ID benchmarks.","url_abs":"https://arxiv.org/abs/2302.14335v1","url_pdf":"https://arxiv.org/pdf/2302.14335v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dc-former-diverse-and-compact-transformer-for","repo_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"person-re-identification","task_name":"Person Re-Identification"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"vision-transformer","method_name":"Vision Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2302.14335","atlas_url":"https://app.syntology.ai/?focus=2302.14335","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.14335"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ant-research/Diverse-and-Compact-Transformer","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ant-research/Diverseand-Compact-Transformer","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6e0d123178c47127","entry":"cosine_dist","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"loss/dissimilar_loss.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/loss/dissimilar_loss.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e0d123178c47127"}},{"code_sha256_prefix":"179ed4238c4ffe31","entry":"euclidean_dist","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"loss/dissimilar_loss.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/loss/dissimilar_loss.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"179ed4238c4ffe31"}},{"code_sha256_prefix":"e3b2a83f52101f2d","entry":"normalize","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"loss/dissimilar_loss.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/loss/dissimilar_loss.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3b2a83f52101f2d"}},{"code_sha256_prefix":"9eadacf338161ccb","entry":"make_loss","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"loss/make_loss.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/loss/make_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9eadacf338161ccb"}},{"code_sha256_prefix":"5f1101145f896208","entry":"read_image","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"datasets/bases.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/datasets/bases.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f1101145f896208"}},{"code_sha256_prefix":"fa0d6dd791ce2927","entry":"shuffle_unit","repo":"ant-research/Diverse-and-Compact-Transformer","repo_kind":"official","path":"model/make_model.py","file_url":"https://github.com/ant-research/Diverse-and-Compact-Transformer/blob/HEAD/model/make_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa0d6dd791ce2927"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}