{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tf-clip-learning-text-free-clip-for-video","title":"TF-CLIP: Learning Text-free CLIP for Video-based Person Re-Identification","arxiv_id":"2312.09627","date":"2023-12-15","proceeding":null,"authors":["Chenyang Yu","Xuehu Liu","Yingquan Wang","Pingping Zhang","Huchuan Lu"],"abstract":"Large-scale language-image pre-trained models (e.g., CLIP) have shown superior performances on many cross-modal retrieval tasks. However, the problem of transferring the knowledge learned from such models to video-based person re-identification (ReID) has barely been explored. In addition, there is a lack of decent text descriptions in current ReID benchmarks. To address these issues, in this work, we propose a novel one-stage text-free CLIP-based learning framework named TF-CLIP for video-based person ReID. More specifically, we extract the identity-specific sequence feature as the CLIP-Memory to replace the text feature. Meanwhile, we design a Sequence-Specific Prompt (SSP) module to update the CLIP-Memory online. To capture temporal information, we further propose a Temporal Memory Diffusion (TMD) module, which consists of two key components: Temporal Memory Construction (TMC) and Memory Diffusion (MD). Technically, TMC allows the frame-level memories in a sequence to communicate with each other, and to extract temporal information based on the relations within the sequence. MD further diffuses the temporal memories to each token in the original features to obtain more robust sequence features. Extensive experiments demonstrate that our proposed method shows much better results than other state-of-the-art methods on MARS, LS-VID and iLIDS-VID. The code is available at https://github.com/AsuradaYuci/TF-CLIP.","url_abs":"https://arxiv.org/abs/2312.09627v1","url_pdf":"https://arxiv.org/pdf/2312.09627v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tf-clip-learning-text-free-clip-for-video","repo_url":"https://github.com/asuradayuci/tf-clip","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"cross-modal-retrieval","task_name":"Cross-Modal Retrieval"},{"task_slug":"person-re-identification","task_name":"Person Re-Identification"},{"task_slug":"video-based-person-re-identification","task_name":"Video-Based Person Re-Identification"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2312.09627","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.09627"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/asuradayuci/tf-clip","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":4,"ran":1,"unverified":5},"by_repo_kind":{"official":{"samples":10,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"98f385d847636a3e","entry":"basic_clean","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/simple_tokenizer.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98f385d847636a3e"}},{"code_sha256_prefix":"d919ae32e5e4e616","entry":"get_pairs","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/simple_tokenizer.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d919ae32e5e4e616"}},{"code_sha256_prefix":"e3b2a83f52101f2d","entry":"normalize","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"loss/triplet_loss.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/loss/triplet_loss.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3b2a83f52101f2d"}},{"code_sha256_prefix":"fcd5b7a9075d588c","entry":"resize_pos_embed","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/model.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fcd5b7a9075d588c"}},{"code_sha256_prefix":"9542161e9640b858","entry":"whitespace_clean","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/simple_tokenizer.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9542161e9640b858"}},{"code_sha256_prefix":"c54ab220c266754d","entry":"build_model","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/model.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c54ab220c266754d"}},{"code_sha256_prefix":"71b4e1d375d8fd78","entry":"cosine_dist","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"loss/triplet_loss.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/loss/triplet_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"71b4e1d375d8fd78"}},{"code_sha256_prefix":"5315f75bf5367f0a","entry":"euclidean_dist","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"loss/triplet_loss.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/loss/triplet_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5315f75bf5367f0a"}},{"code_sha256_prefix":"5e6d9228390a2c30","entry":"load","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"model/clip/clip.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/model/clip/clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e6d9228390a2c30"}},{"code_sha256_prefix":"38f935583212d5cc","entry":"make_loss","repo":"asuradayuci/tf-clip","repo_kind":"official","path":"loss/make_loss.py","file_url":"https://github.com/asuradayuci/tf-clip/blob/HEAD/loss/make_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38f935583212d5cc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}