{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/overcoming-catastrophic-forgetting-in-1","title":"Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation","arxiv_id":"2204.02136","date":"2022-04-05","proceeding":"CVPR 2022 1","authors":["Tao Feng","Mang Wang","Hangjie Yuan"],"abstract":"Traditional object detectors are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will lead to catastrophic forgetting. Knowledge distillation is a flexible way to mitigate catastrophic forgetting. In Incremental Object Detection (IOD), previous work mainly focuses on distilling for the combination of features and responses. However, they under-explore the information that contains in responses. In this paper, we propose a response-based incremental distillation method, dubbed Elastic Response Distillation (ERD), which focuses on elastically learning responses from the classification head and the regression head. Firstly, our method transfers category knowledge while equipping student detector with the ability to retain localization information during incremental learning. In addition, we further evaluate the quality of all locations and provide valuable responses by the Elastic Response Selection (ERS) strategy. Finally, we elucidate that the knowledge from different responses should be assigned with different importance during incremental distillation. Extensive experiments conducted on MS COCO demonstrate our method achieves state-of-the-art result, which substantially narrows the performance gap towards full training.","url_abs":"https://arxiv.org/abs/2204.02136v1","url_pdf":"https://arxiv.org/pdf/2204.02136v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"overcoming-catastrophic-forgetting-in-1","repo_url":"https://github.com/hi-ft/erd","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":null,"task_name":"Class-Incremental Object Detection"},{"task_slug":"incremental-learning","task_name":"Incremental Learning"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2204.02136","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.02136"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hi-ft/erd","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/Hi-FT/ERD","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4e2dcdfe578946a0","entry":"check_link","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/check_links.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/check_links.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4e2dcdfe578946a0"}},{"code_sha256_prefix":"cc93fdc812eca8f7","entry":"check_url","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/check_links.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/check_links.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc93fdc812eca8f7"}},{"code_sha256_prefix":"3175ca3b1ec8c7b9","entry":"process_model_info","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/convert_test_benchmark_script.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/convert_test_benchmark_script.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3175ca3b1ec8c7b9"}},{"code_sha256_prefix":"fd08138d4bde9cfa","entry":"check_path","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/check_links.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/check_links.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fd08138d4bde9cfa"}},{"code_sha256_prefix":"8ff99a6bd2ebf598","entry":"ordered_yaml_dump","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/gather_models.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/gather_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8ff99a6bd2ebf598"}},{"code_sha256_prefix":"138e112e22b0314e","entry":"process_checkpoint","repo":"Hi-FT/ERD","repo_kind":"official","path":".dev_scripts/gather_models.py","file_url":"https://github.com/Hi-FT/ERD/blob/HEAD/.dev_scripts/gather_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"138e112e22b0314e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}