{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/class-incremental-learning-by-knowledge","title":"Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation","arxiv_id":"2204.00895","date":"2022-04-02","proceeding":"CVPR 2022 1","authors":["Minsoo Kang","Jaeyoo Park","Bohyung Han"],"abstract":"We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and provides a principled way to maintain the representations of old models while adjusting to new tasks effectively. The proposed method estimates the relationship between the representation changes and the resulting loss increases incurred by model updates. It minimizes the upper bound of the loss increases using the representations, which exploits the estimated importance of each feature map within a backbone model. Based on the importance, the model restricts updates of important features for robustness while allowing changes in less critical features for flexibility. This optimization strategy effectively alleviates the notorious catastrophic forgetting problem despite the limited accessibility of data in the previous tasks. The experimental results show significant accuracy improvement of the proposed algorithm over the existing methods on the standard datasets. Code is available.","url_abs":"https://arxiv.org/abs/2204.00895v1","url_pdf":"https://arxiv.org/pdf/2204.00895v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"class-incremental-learning-by-knowledge","repo_url":"https://github.com/kminsoo/afc","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"class-incremental-learning","task_name":"Class Incremental Learning"},{"task_slug":"incremental-learning","task_name":"Incremental Learning"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"class-incremental-learning-1","task_name":"class-incremental learning"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.00895","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.00895"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kminsoo/afc","reach":{"status":"ok"}}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"761396379069d4b2","entry":"BoundClipper","repo":"kminsoo/afc","repo_kind":"official","path":"inclearn/models/afc.py","file_url":"https://github.com/kminsoo/afc/blob/HEAD/inclearn/models/afc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"761396379069d4b2"}},{"code_sha256_prefix":"10e817601f70b5f6","entry":"IncrementalLearner","repo":"kminsoo/afc","repo_kind":"official","path":"inclearn/models/afc.py","file_url":"https://github.com/kminsoo/afc/blob/HEAD/inclearn/models/afc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"10e817601f70b5f6"}},{"code_sha256_prefix":"d8d876940923b3a3","entry":"AFC","repo":"kminsoo/afc","repo_kind":"official","path":"inclearn/models/afc.py","file_url":"https://github.com/kminsoo/afc/blob/HEAD/inclearn/models/afc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d8d876940923b3a3"}},{"code_sha256_prefix":"9e2d38306aad954d","entry":"ICarl","repo":"kminsoo/afc","repo_kind":"official","path":"inclearn/models/afc.py","file_url":"https://github.com/kminsoo/afc/blob/HEAD/inclearn/models/afc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e2d38306aad954d"}},{"code_sha256_prefix":"417665dad50d20a6","entry":"_clean_list","repo":"kminsoo/afc","repo_kind":"official","path":"inclearn/models/afc.py","file_url":"https://github.com/kminsoo/afc/blob/HEAD/inclearn/models/afc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"417665dad50d20a6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}