{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/continual-learning-in-the-frequency-domain","title":"Continual Learning in the Frequency Domain","arxiv_id":"2410.06645","date":"2024-10-09","proceeding":null,"authors":["Ruiqi Liu","Boyu Diao","Libo Huang","Zijia An","Zhulin An","Yongjun Xu"],"abstract":"Continual learning (CL) is designed to learn new tasks while preserving existing knowledge. Replaying samples from earlier tasks has proven to be an effective method to mitigate the forgetting of previously acquired knowledge. However, the current research on the training efficiency of rehearsal-based methods is insufficient, which limits the practical application of CL systems in resource-limited scenarios. The human visual system (HVS) exhibits varying sensitivities to different frequency components, enabling the efficient elimination of visually redundant information. Inspired by HVS, we propose a novel framework called Continual Learning in the Frequency Domain (CLFD). To our knowledge, this is the first study to utilize frequency domain features to enhance the performance and efficiency of CL training on edge devices. For the input features of the feature extractor, CLFD employs wavelet transform to map the original input image into the frequency domain, thereby effectively reducing the size of input feature maps. Regarding the output features of the feature extractor, CLFD selectively utilizes output features for distinct classes for classification, thereby balancing the reusability and interference of output features based on the frequency domain similarity of the classes across various tasks. Optimizing only the input and output features of the feature extractor allows for seamless integration of CLFD with various rehearsal-based methods. Extensive experiments conducted in both cloud and edge environments demonstrate that CLFD consistently improves the performance of state-of-the-art (SOTA) methods in both precision and training efficiency. Specifically, CLFD can increase the accuracy of the SOTA CL method by up to 6.83% and reduce the training time by 2.6$\\times$.","url_abs":"https://arxiv.org/abs/2410.06645v4","url_pdf":"https://arxiv.org/pdf/2410.06645v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"continual-learning-in-the-frequency-domain","repo_url":"https://github.com/EMLS-ICTCAS/CLFD","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.06645","atlas_url":"https://app.syntology.ai/?focus=2410.06645","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.06645"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/EMLS-ICTCAS/CLFD","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"ran_draft_wrong":2,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7e7efa6d1976111a","entry":"calculate_output_image_size","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/EfficientNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e7efa6d1976111a"}},{"code_sha256_prefix":"2a80220dabcb742a","entry":"conv1x1","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/ResNet50.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/ResNet50.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a80220dabcb742a"}},{"code_sha256_prefix":"600ff2c45e0de056","entry":"conv3x3","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/ResNet50.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/ResNet50.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"600ff2c45e0de056"}},{"code_sha256_prefix":"4c2989ace7c5c0da","entry":"conv3x3","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/DWTNet.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/DWTNet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c2989ace7c5c0da"}},{"code_sha256_prefix":"25e04c3b7a8cc075","entry":"conv3x3","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/ResNet18.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/ResNet18.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25e04c3b7a8cc075"}},{"code_sha256_prefix":"f1e3c822763f3ebb","entry":"drop_connect","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/EfficientNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1e3c822763f3ebb"}},{"code_sha256_prefix":"1e2dad967f965366","entry":"get_width_and_height_from_size","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/EfficientNet.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/EfficientNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e2dad967f965366"}},{"code_sha256_prefix":"7d8b5192116844f8","entry":"DWT_resnet18","repo":"EMLS-ICTCAS/CLFD","repo_kind":"official","path":"backbone/DWTNet.py","file_url":"https://github.com/EMLS-ICTCAS/CLFD/blob/HEAD/backbone/DWTNet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d8b5192116844f8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}