{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/it-s-all-about-consistency-a-study-on-memory","title":"Memory Population in Continual Learning via Outlier Elimination","arxiv_id":"2207.01145","date":"2022-07-04","proceeding":null,"authors":["Julio Hurtado","Alain Raymond-Saez","Vladimir Araujo","Vincenzo Lomonaco","Alvaro Soto","Davide Bacciu"],"abstract":"Catastrophic forgetting, the phenomenon of forgetting previously learned tasks when learning a new one, is a major hurdle in developing continual learning algorithms. A popular method to alleviate forgetting is to use a memory buffer, which stores a subset of previously learned task examples for use during training on new tasks. The de facto method of filling memory is by randomly selecting previous examples. However, this process could introduce outliers or noisy samples that could hurt the generalization of the model. This paper introduces Memory Outlier Elimination (MOE), a method for identifying and eliminating outliers in the memory buffer by choosing samples from label-homogeneous subpopulations. We show that a space with a high homogeneity is related to a feature space that is more representative of the class distribution. In practice, MOE removes a sample if it is surrounded by samples from different labels. We demonstrate the effectiveness of MOE on CIFAR-10, CIFAR-100, and CORe50, outperforming previous well-known memory population methods.","url_abs":"https://arxiv.org/abs/2207.01145v3","url_pdf":"https://arxiv.org/pdf/2207.01145v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"it-s-all-about-consistency-a-study-on-memory","repo_url":"https://github.com/JuliousHurtado/MOE","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"}],"methods":[{"method_slug":"aware","method_name":"AWARE"},{"method_slug":"experience-replay","method_name":"Experience Replay"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2207.01145","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.01145"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/JuliousHurtado/MOE","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"unverified":5},"by_repo_kind":{"official":{"samples":6,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f6be833ba409926f","entry":"pil_loader","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"datasets/tiny_imagenet.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/datasets/tiny_imagenet.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6be833ba409926f"}},{"code_sha256_prefix":"b165863bf85fac03","entry":"CIFARIdx","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"datasets/load_c_score.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/datasets/load_c_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b165863bf85fac03"}},{"code_sha256_prefix":"4c2989ace7c5c0da","entry":"conv3x3","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c2989ace7c5c0da"}},{"code_sha256_prefix":"01d59f4ea54b7d14","entry":"get_dataset_class","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"datasets/get_dataset.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/datasets/get_dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"01d59f4ea54b7d14"}},{"code_sha256_prefix":"3e0ef5df374d5101","entry":"make_path","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"datasets/load_c_score.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/datasets/load_c_score.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e0ef5df374d5101"}},{"code_sha256_prefix":"f187476091955130","entry":"resnet18","repo":"JuliousHurtado/MOE","repo_kind":"official","path":"models/resnet.py","file_url":"https://github.com/JuliousHurtado/MOE/blob/HEAD/models/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f187476091955130"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}