{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/regularizing-second-order-influences-for","title":"Regularizing Second-Order Influences for Continual Learning","arxiv_id":"2304.10177","date":"2023-04-20","proceeding":"CVPR 2023 1","authors":["Zhicheng Sun","Yadong Mu","Gang Hua"],"abstract":"Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a delicate sample selection strategy is required. However, existing selection schemes typically seek only to maximize the utility of the ongoing selection, overlooking the interference between successive rounds of selection. Motivated by this, we dissect the interaction of sequential selection steps within a framework built on influence functions. We manage to identify a new class of second-order influences that will gradually amplify incidental bias in the replay buffer and compromise the selection process. To regularize the second-order effects, a novel selection objective is proposed, which also has clear connections to two widely adopted criteria. Furthermore, we present an efficient implementation for optimizing the proposed criterion. Experiments on multiple continual learning benchmarks demonstrate the advantage of our approach over state-of-the-art methods. Code is available at https://github.com/feifeiobama/InfluenceCL.","url_abs":"https://arxiv.org/abs/2304.10177v1","url_pdf":"https://arxiv.org/pdf/2304.10177v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"regularizing-second-order-influences-for","repo_url":"https://github.com/feifeiobama/InfluenceCL","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"}],"methods":[{"method_slug":"coresets","method_name":"Coresets"},{"method_slug":"experience-replay","method_name":"Experience Replay"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2304.10177","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.10177"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/feifeiobama/InfluenceCL","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7e7efa6d1976111a","entry":"calculate_output_image_size","repo":"feifeiobama/InfluenceCL","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/feifeiobama/InfluenceCL/blob/HEAD/backbone/EfficientNet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e7efa6d1976111a"}},{"code_sha256_prefix":"f1e3c822763f3ebb","entry":"drop_connect","repo":"feifeiobama/InfluenceCL","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/feifeiobama/InfluenceCL/blob/HEAD/backbone/EfficientNet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1e3c822763f3ebb"}},{"code_sha256_prefix":"1e2dad967f965366","entry":"get_width_and_height_from_size","repo":"feifeiobama/InfluenceCL","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/feifeiobama/InfluenceCL/blob/HEAD/backbone/EfficientNet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e2dad967f965366"}},{"code_sha256_prefix":"5d65b508e8b1cbad","entry":"project","repo":"feifeiobama/InfluenceCL","repo_kind":"official","path":"models/agem.py","file_url":"https://github.com/feifeiobama/InfluenceCL/blob/HEAD/models/agem.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d65b508e8b1cbad"}},{"code_sha256_prefix":"4c2989ace7c5c0da","entry":"conv3x3","repo":"feifeiobama/InfluenceCL","repo_kind":"official","path":"backbone/ResNet18.py","file_url":"https://github.com/feifeiobama/InfluenceCL/blob/HEAD/backbone/ResNet18.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c2989ace7c5c0da"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}