{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rotate-your-networks-better-weight","title":"Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting","arxiv_id":"1802.02950","date":"2018-02-08","proceeding":null,"authors":["Xialei Liu","Marc Masana","Luis Herranz","Joost Van de Weijer","Antonio M. Lopez","Andrew D. Bagdanov"],"abstract":"In this paper we propose an approach to avoiding catastrophic forgetting in\nsequential task learning scenarios. Our technique is based on a network\nreparameterization that approximately diagonalizes the Fisher Information\nMatrix of the network parameters. This reparameterization takes the form of a\nfactorized rotation of parameter space which, when used in conjunction with\nElastic Weight Consolidation (which assumes a diagonal Fisher Information\nMatrix), leads to significantly better performance on lifelong learning of\nsequential tasks. Experimental results on the MNIST, CIFAR-100, CUB-200 and\nStanford-40 datasets demonstrate that we significantly improve the results of\nstandard elastic weight consolidation, and that we obtain competitive results\nwhen compared to other state-of-the-art in lifelong learning without\nforgetting.","url_abs":"http://arxiv.org/abs/1802.02950v4","url_pdf":"http://arxiv.org/pdf/1802.02950v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rotate-your-networks-better-weight","repo_url":"https://github.com/xialeiliu/RotateNetworks","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"rotate-your-networks-better-weight","repo_url":"https://github.com/srvCodes/continual-learning-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"lifelong-learning","task_name":"Lifelong learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1802.02950","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1802.02950"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/srvCodes/continual-learning-benchmark","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xialeiliu/RotateNetworks","reach":null}],"summary":{"ran_fixture":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"519322e2bab1faca","entry":"aug","repo":"xialeiliu/RotateNetworks","repo_kind":"official","path":"utils/utils_cifar100.py","file_url":"https://github.com/xialeiliu/RotateNetworks/blob/HEAD/utils/utils_cifar100.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"519322e2bab1faca"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}