{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/substitute-teacher-networks-learning-with","title":"Substitute Teacher Networks: Learning with Almost No Supervision","arxiv_id":"1803.11560","date":"2018-04-01","proceeding":null,"authors":["Samuel Albanie","James Thewlis","Joao F. Henriques"],"abstract":"Learning through experience is time-consuming, inefficient and often bad for\nyour cortisol levels. To address this problem, a number of recently proposed\nteacher-student methods have demonstrated the benefits of private tuition, in\nwhich a single model learns from an ensemble of more experienced tutors.\nUnfortunately, the cost of such supervision restricts good representations to a\nprivileged minority. Unsupervised learning can be used to lower tuition fees,\nbut runs the risk of producing networks that require extracurriculum learning\nto strengthen their CVs and create their own LinkedIn profiles. Inspired by the\nlogo on a promotional stress ball at a local recruitment fair, we make the\nfollowing three contributions. First, we propose a novel almost no supervision\ntraining algorithm that is effective, yet highly scalable in the number of\nstudent networks being supervised, ensuring that education remains affordable.\nSecond, we demonstrate our approach on a typical use case: learning to bake,\ndeveloping a method that tastily surpasses the current state of the art.\nFinally, we provide a rigorous quantitive analysis of our method, proving that\nwe have access to a calculator. Our work calls into question the long-held\ndogma that life is the best teacher.","url_abs":"http://arxiv.org/abs/1803.11560v1","url_pdf":"http://arxiv.org/pdf/1803.11560v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"substitute-teacher-networks-learning-with","repo_url":"https://github.com/albanie/SIGBOVIK18-STNs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}