{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/class-incremental-learning-with-clip-adaptive","title":"Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusion","arxiv_id":"2407.14143","date":"2024-07-19","proceeding":null,"authors":["Linlan Huang","Xusheng Cao","Haori Lu","Xialei Liu"],"abstract":"Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they demonstrate good generalization ability that allows them to excel in class-incremental learning with completely frozen parameters. However, further adaptation to downstream tasks by simply fine-tuning the model leads to severe forgetting. Most existing works with pre-trained models assume that the forgetting of old classes is uniform when the model acquires new knowledge. In this paper, we propose a method named Adaptive Representation Adjustment and Parameter Fusion (RAPF). During training for new data, we measure the influence of new classes on old ones and adjust the representations, using textual features. After training, we employ a decomposed parameter fusion to further mitigate forgetting during adapter module fine-tuning. Experiments on several conventional benchmarks show that our method achieves state-of-the-art results. Our code is available at \\url{https://github.com/linlany/RAPF}.","url_abs":"https://arxiv.org/abs/2407.14143v1","url_pdf":"https://arxiv.org/pdf/2407.14143v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"class-incremental-learning-with-clip-adaptive","repo_url":"https://github.com/linlany/rapf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"class-incremental-learning","task_name":"Class Incremental Learning"},{"task_slug":"incremental-learning","task_name":"Incremental Learning"},{"task_slug":"class-incremental-learning-1","task_name":"class-incremental learning"}],"methods":[{"method_slug":"adapter","method_name":"Adapter"},{"method_slug":"clip","method_name":"CLIP"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.14143","atlas_url":"https://app.syntology.ai/?focus=2407.14143","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.14143"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/linlany/rapf","reach":{"status":"ok"}}],"summary":{"ran":5},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"dd95b40fe2fbf33f","entry":"get_class_names","repo":"linlany/rapf","repo_kind":"official","path":"continual_clip/utils.py","file_url":"https://github.com/linlany/rapf/blob/HEAD/continual_clip/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dd95b40fe2fbf33f"}},{"code_sha256_prefix":"1e44d7843ade1f71","entry":"get_class_order","repo":"linlany/rapf","repo_kind":"official","path":"continual_clip/utils.py","file_url":"https://github.com/linlany/rapf/blob/HEAD/continual_clip/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1e44d7843ade1f71"}},{"code_sha256_prefix":"70fbccb49de9784d","entry":"get_dataset_class_names","repo":"linlany/rapf","repo_kind":"official","path":"continual_clip/utils.py","file_url":"https://github.com/linlany/rapf/blob/HEAD/continual_clip/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"70fbccb49de9784d"}},{"code_sha256_prefix":"6e340bdc8322ef41","entry":"sample","repo":"linlany/rapf","repo_kind":"official","path":"continual_clip/models.py","file_url":"https://github.com/linlany/rapf/blob/HEAD/continual_clip/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6e340bdc8322ef41"}},{"code_sha256_prefix":"8334cbd9372bf587","entry":"shrink_cov","repo":"linlany/rapf","repo_kind":"official","path":"continual_clip/models.py","file_url":"https://github.com/linlany/rapf/blob/HEAD/continual_clip/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8334cbd9372bf587"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}