{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/uncertainty-guided-continual-learning-with","title":"Uncertainty-guided Continual Learning with Bayesian Neural Networks","arxiv_id":"1906.02425","date":"2019-06-06","proceeding":"ICLR 2020 1","authors":["Sayna Ebrahimi","Mohamed Elhoseiny","Trevor Darrell","Marcus Rohrbach"],"abstract":"Continual learning aims to learn new tasks without forgetting previously learned ones. This is especially challenging when one cannot access data from previous tasks and when the model has a fixed capacity. Current regularization-based continual learning algorithms need an external representation and extra computation to measure the parameters' \\textit{importance}. In contrast, we propose Uncertainty-guided Continual Bayesian Neural Networks (UCB), where the learning rate adapts according to the uncertainty defined in the probability distribution of the weights in networks. Uncertainty is a natural way to identify \\textit{what to remember} and \\textit{what to change} as we continually learn, and thus mitigate catastrophic forgetting. We also show a variant of our model, which uses uncertainty for weight pruning and retains task performance after pruning by saving binary masks per tasks. We evaluate our UCB approach extensively on diverse object classification datasets with short and long sequences of tasks and report superior or on-par performance compared to existing approaches. Additionally, we show that our model does not necessarily need task information at test time, i.e. it does not presume knowledge of which task a sample belongs to.","url_abs":"https://arxiv.org/abs/1906.02425v2","url_pdf":"https://arxiv.org/pdf/1906.02425v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"uncertainty-guided-continual-learning-with","repo_url":"https://github.com/SaynaEbrahimi/UCB","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"uncertainty-guided-continual-learning-with","repo_url":"https://github.com/SaynaEbrahimi/BayesianContinualLearning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1906.02425","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.02425"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SaynaEbrahimi/UCB","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SaynaEbrahimi/BayesianContinualLearning","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_violates":1,"ran_draft_wrong":1,"unverified":9},"by_repo_kind":{"official":{"samples":11,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0fe9cf6c00ef56ea","entry":"is_number","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/utils.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":2,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0fe9cf6c00ef56ea"}},{"code_sha256_prefix":"eb4492b8e8e4c8a7","entry":"human_format","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eb4492b8e8e4c8a7"}},{"code_sha256_prefix":"f3ba7ada669d2d03","entry":"Net","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/networks/mlp_ucb.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/networks/mlp_ucb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f3ba7ada669d2d03"}},{"code_sha256_prefix":"278d3ba66464aecf","entry":"Net","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/networks/resnet_ucb.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/networks/resnet_ucb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"278d3ba66464aecf"}},{"code_sha256_prefix":"c7994f266fbc4ab3","entry":"conv3x3","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/networks/resnet_ucb.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/networks/resnet_ucb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7994f266fbc4ab3"}},{"code_sha256_prefix":"f497ffa094e5187d","entry":"get","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/dataloaders/cifar.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/dataloaders/cifar.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f497ffa094e5187d"}},{"code_sha256_prefix":"c141139ade360683","entry":"get","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/dataloaders/mixture.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/dataloaders/mixture.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c141139ade360683"}},{"code_sha256_prefix":"8b6d1b5f5705f3d7","entry":"get","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/dataloaders/mnist2.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/dataloaders/mnist2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b6d1b5f5705f3d7"}},{"code_sha256_prefix":"da97457bd98cf9b8","entry":"get","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/dataloaders/mnist5.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/dataloaders/mnist5.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da97457bd98cf9b8"}},{"code_sha256_prefix":"690c5890415e69c3","entry":"get","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/dataloaders/pmnist.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/dataloaders/pmnist.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"690c5890415e69c3"}},{"code_sha256_prefix":"59aaf24fd0c63e49","entry":"print_model_report","repo":"SaynaEbrahimi/UCB","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/SaynaEbrahimi/UCB/blob/HEAD/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"59aaf24fd0c63e49"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}