{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lifelong-teacher-student-network-learning","title":"Lifelong Teacher-Student Network Learning","arxiv_id":"2107.04689","date":"2021-07-09","proceeding":null,"authors":["Fei Ye","Adrian G. Bors"],"abstract":"A unique cognitive capability of humans consists in their ability to acquire new knowledge and skills from a sequence of experiences. Meanwhile, artificial intelligence systems are good at learning only the last given task without being able to remember the databases learnt in the past. We propose a novel lifelong learning methodology by employing a Teacher-Student network framework. While the Student module is trained with a new given database, the Teacher module would remind the Student about the information learnt in the past. The Teacher, implemented by a Generative Adversarial Network (GAN), is trained to preserve and replay past knowledge corresponding to the probabilistic representations of previously learn databases. Meanwhile, the Student module is implemented by a Variational Autoencoder (VAE) which infers its latent variable representation from both the output of the Teacher module as well as from the newly available database. Moreover, the Student module is trained to capture both continuous and discrete underlying data representations across different domains. The proposed lifelong learning framework is applied in supervised, semi-supervised and unsupervised training. The code is available~: \\url{https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning}","url_abs":"https://arxiv.org/abs/2107.04689v1","url_pdf":"https://arxiv.org/pdf/2107.04689v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lifelong-teacher-student-network-learning","repo_url":"https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":null,"task_name":"Generative Adversarial Network"},{"task_slug":"lifelong-learning","task_name":"Lifelong learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2107.04689","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.04689"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning","reach":null}],"summary":{"ran_honours":1,"unverified":2},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"35fbfb1ad8ac6f47","entry":"file_name","repo":"dtuzi123/Lifelong-Teacher-Student-Network-Learning","repo_kind":"official","path":"TeacherStudent_Supervised.py","file_url":"https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning/blob/HEAD/TeacherStudent_Supervised.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"35fbfb1ad8ac6f47"}},{"code_sha256_prefix":"4d083f1020840eaa","entry":"Code_Classifier","repo":"dtuzi123/Lifelong-Teacher-Student-Network-Learning","repo_kind":"official","path":"TeacherStudent_Supervised.py","file_url":"https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning/blob/HEAD/TeacherStudent_Supervised.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4d083f1020840eaa"}},{"code_sha256_prefix":"08702893e876cbf5","entry":"sample_gumbel","repo":"dtuzi123/Lifelong-Teacher-Student-Network-Learning","repo_kind":"official","path":"TeacherStudent_Supervised.py","file_url":"https://github.com/dtuzi123/Lifelong-Teacher-Student-Network-Learning/blob/HEAD/TeacherStudent_Supervised.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08702893e876cbf5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}