{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/class-incremental-learning-via-deep-model","title":"Class-incremental Learning via Deep Model Consolidation","arxiv_id":"1903.07864","date":"2019-03-19","proceeding":null,"authors":["Junting Zhang","Jie Zhang","Shalini Ghosh","Dawei Li","Serafettin Tasci","Larry Heck","Heming Zhang","C. -C. Jay Kuo"],"abstract":"Deep neural networks (DNNs) often suffer from \"catastrophic forgetting\" during incremental learning (IL) --- an abrupt degradation of performance on the original set of classes when the training objective is adapted to a newly added set of classes. Existing IL approaches tend to produce a model that is biased towards either the old classes or new classes, unless with the help of exemplars of the old data. To address this issue, we propose a class-incremental learning paradigm called Deep Model Consolidation (DMC), which works well even when the original training data is not available. The idea is to first train a separate model only for the new classes, and then combine the two individual models trained on data of two distinct set of classes (old classes and new classes) via a novel double distillation training objective. The two existing models are consolidated by exploiting publicly available unlabeled auxiliary data. This overcomes the potential difficulties due to the unavailability of original training data. Compared to the state-of-the-art techniques, DMC demonstrates significantly better performance in image classification (CIFAR-100 and CUB-200) and object detection (PASCAL VOC 2007) in the single-headed IL setting.","url_abs":"https://arxiv.org/abs/1903.07864v4","url_pdf":"https://arxiv.org/pdf/1903.07864v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"class-incremental-learning-via-deep-model","repo_url":"https://github.com/juntingzh/incremental-learning-baselines","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"class-incremental-learning-via-deep-model","repo_url":"https://github.com/mmasana/FACIL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"class-incremental-learning","task_name":"Class Incremental Learning"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"incremental-learning","task_name":"Incremental Learning"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"class-incremental-learning-1","task_name":"class-incremental learning"},{"task_slug":"image-classification","task_name":"image-classification"},{"task_slug":"model","task_name":"model"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1903.07864","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1903.07864"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mmasana/FACIL","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/juntingzh/incremental-learning-baselines","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"unverified":7},"by_repo_kind":{"listed":{"samples":8,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"f5ffbe87b7ec7cb6","entry":"create_fc_layer","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"utils/utils.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/utils/utils.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"f5ffbe87b7ec7cb6"}},{"code_sha256_prefix":"a96da1b71ad1a9ef","entry":"bias_variable","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"model/model.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/model/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"a96da1b71ad1a9ef"}},{"code_sha256_prefix":"687d5d0cc60d8e5a","entry":"clone_variable_list","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"utils/utils.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/utils/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"687d5d0cc60d8e5a"}},{"code_sha256_prefix":"4531aa012b415174","entry":"create_conv_layer","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"utils/utils.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/utils/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"4531aa012b415174"}},{"code_sha256_prefix":"3082ab8372165acb","entry":"test_task_sequence","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"fc_permute_mnist.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/fc_permute_mnist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"3082ab8372165acb"}},{"code_sha256_prefix":"30e387d6f5d1ab03","entry":"vgg_conv_layer","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"utils/vgg_utils.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/utils/vgg_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"30e387d6f5d1ab03"}},{"code_sha256_prefix":"dceae2df5c5c47ec","entry":"vgg_fc_layer","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"utils/vgg_utils.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/utils/vgg_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"dceae2df5c5c47ec"}},{"code_sha256_prefix":"70fae4aed55bdadc","entry":"weight_variable","repo":"juntingzh/incremental-learning-baselines","repo_kind":"listed","path":"model/model.py","file_url":"https://github.com/juntingzh/incremental-learning-baselines/blob/HEAD/model/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"mcp_get_code":{"code_sha256":"70fae4aed55bdadc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}