{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-to-forget-for-meta-learning","title":"Learning to Forget for Meta-Learning","arxiv_id":"1906.05895","date":"2019-06-13","proceeding":"CVPR 2020 6","authors":["Sungyong Baik","Seokil Hong","Kyoung Mu Lee"],"abstract":"Few-shot learning is a challenging problem where the goal is to achieve generalization from only few examples. Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks, which is then used to quickly adapt to unseen tasks. However, forcibly sharing an initialization can lead to conflicts among tasks and the compromised (undesired by tasks) location on optimization landscape, thereby hindering the task adaptation. Further, we observe that the degree of conflict differs among not only tasks but also layers of a neural network. Thus, we propose task-and-layer-wise attenuation on the compromised initialization to reduce its influence. As the attenuation dynamically controls (or selectively forgets) the influence of prior knowledge for a given task and each layer, we name our method as L2F (Learn to Forget). The experimental results demonstrate that the proposed method provides faster adaptation and greatly improves the performance. Furthermore, L2F can be easily applied and improve other state-of-the-art MAML-based frameworks, illustrating its simplicity and generalizability.","url_abs":"https://arxiv.org/abs/1906.05895v2","url_pdf":"https://arxiv.org/pdf/1906.05895v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-to-forget-for-meta-learning","repo_url":"https://github.com/baiksung/L2F","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"meta-learning","task_name":"Meta-Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1906.05895","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.05895"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/baiksung/L2F","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"unverified":6},"by_repo_kind":{"official":{"samples":8,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"94cd47c72a983ad8","entry":"extract_top_level_dict","repo":"baiksung/L2F","repo_kind":"official","path":"meta_neural_network_architectures.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/meta_neural_network_architectures.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94cd47c72a983ad8"}},{"code_sha256_prefix":"5c44538154dad8a7","entry":"set_torch_seed","repo":"baiksung/L2F","repo_kind":"official","path":"few_shot_learning_system.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/few_shot_learning_system.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5c44538154dad8a7"}},{"code_sha256_prefix":"1692a3e6d0e46fb5","entry":"augment_image","repo":"baiksung/L2F","repo_kind":"official","path":"data.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1692a3e6d0e46fb5"}},{"code_sha256_prefix":"632e39376f13aefe","entry":"extract_args_from_json","repo":"baiksung/L2F","repo_kind":"official","path":"utils/parser_utils.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/utils/parser_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"632e39376f13aefe"}},{"code_sha256_prefix":"b861fb9443b8231f","entry":"get_transforms_for_dataset","repo":"baiksung/L2F","repo_kind":"official","path":"data.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b861fb9443b8231f"}},{"code_sha256_prefix":"1ffc7f12a771c7d6","entry":"load_from_json","repo":"baiksung/L2F","repo_kind":"official","path":"utils/storage.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/utils/storage.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ffc7f12a771c7d6"}},{"code_sha256_prefix":"b85351bca4ccbe20","entry":"load_statistics","repo":"baiksung/L2F","repo_kind":"official","path":"utils/storage.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/utils/storage.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b85351bca4ccbe20"}},{"code_sha256_prefix":"822e342d8175533c","entry":"save_statistics","repo":"baiksung/L2F","repo_kind":"official","path":"utils/storage.py","file_url":"https://github.com/baiksung/L2F/blob/HEAD/utils/storage.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"822e342d8175533c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}