{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/task-aware-information-routing-from-common","title":"Task-Aware Information Routing from Common Representation Space in Lifelong Learning","arxiv_id":"2302.11346","date":"2023-02-14","proceeding":null,"authors":["Prashant Bhat","Bahram Zonooz","Elahe Arani"],"abstract":"Intelligent systems deployed in the real world suffer from catastrophic forgetting when exposed to a sequence of tasks. Humans, on the other hand, acquire, consolidate, and transfer knowledge between tasks that rarely interfere with the consolidated knowledge. Accompanied by self-regulated neurogenesis, continual learning in the brain is governed by a rich set of neurophysiological processes that harbor different types of knowledge, which are then integrated by conscious processing. Thus, inspired by the Global Workspace Theory of conscious information access in the brain, we propose TAMiL, a continual learning method that entails task-attention modules to capture task-specific information from the common representation space. We employ simple, undercomplete autoencoders to create a communication bottleneck between the common representation space and the global workspace, allowing only the task-relevant information to the global workspace, thus greatly reducing task interference. Experimental results show that our method outperforms state-of-the-art rehearsal-based and dynamic sparse approaches and bridges the gap between fixed capacity and parameter isolation approaches while being scalable. We also show that our method effectively mitigates catastrophic forgetting while being well-calibrated with reduced task-recency bias.","url_abs":"https://arxiv.org/abs/2302.11346v1","url_pdf":"https://arxiv.org/pdf/2302.11346v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"task-aware-information-routing-from-common","repo_url":"https://github.com/neurai-lab/tamil","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"continual-learning","task_name":"Continual Learning"},{"task_slug":"lifelong-learning","task_name":"Lifelong learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2302.11346","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.11346"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/neurai-lab/tamil","reach":null}],"summary":{"ran":3,"ran_fixture":1,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"1f0a698eea371060","entry":"Buffer","repo":"neurai-lab/tamil","repo_kind":"official","path":"models/tam.py","file_url":"https://github.com/neurai-lab/tamil/blob/HEAD/models/tam.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1f0a698eea371060"}},{"code_sha256_prefix":"e05a511f5e2451f1","entry":"ContinualModel","repo":"neurai-lab/tamil","repo_kind":"official","path":"models/tam.py","file_url":"https://github.com/neurai-lab/tamil/blob/HEAD/models/tam.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e05a511f5e2451f1"}},{"code_sha256_prefix":"509beca0a9b362bf","entry":"get_device","repo":"neurai-lab/tamil","repo_kind":"official","path":"models/tam.py","file_url":"https://github.com/neurai-lab/tamil/blob/HEAD/models/tam.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"509beca0a9b362bf"}},{"code_sha256_prefix":"3e30d88eaef01190","entry":"off_diagonal","repo":"neurai-lab/tamil","repo_kind":"official","path":"models/tam.py","file_url":"https://github.com/neurai-lab/tamil/blob/HEAD/models/tam.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3e30d88eaef01190"}},{"code_sha256_prefix":"6d075e0dadcdcbb6","entry":"TAM","repo":"neurai-lab/tamil","repo_kind":"official","path":"models/tam.py","file_url":"https://github.com/neurai-lab/tamil/blob/HEAD/models/tam.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6d075e0dadcdcbb6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}