{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hypershot-few-shot-learning-by-kernel","title":"HyperShot: Few-Shot Learning by Kernel HyperNetworks","arxiv_id":"2203.11378","date":"2022-03-21","proceeding":null,"authors":["Marcin Sendera","Marcin Przewięźlikowski","Konrad Karanowski","Maciej Zięba","Jacek Tabor","Przemysław Spurek"],"abstract":"Few-shot models aim at making predictions using a minimal number of labeled examples from a given task. The main challenge in this area is the one-shot setting where only one element represents each class. We propose HyperShot - the fusion of kernels and hypernetwork paradigm. Compared to reference approaches that apply a gradient-based adjustment of the parameters, our model aims to switch the classification module parameters depending on the task's embedding. In practice, we utilize a hypernetwork, which takes the aggregated information from support data and returns the classifier's parameters handcrafted for the considered problem. Moreover, we introduce the kernel-based representation of the support examples delivered to hypernetwork to create the parameters of the classification module. Consequently, we rely on relations between embeddings of the support examples instead of direct feature values provided by the backbone models. Thanks to this approach, our model can adapt to highly different tasks.","url_abs":"https://arxiv.org/abs/2203.11378v1","url_pdf":"https://arxiv.org/pdf/2203.11378v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hypershot-few-shot-learning-by-kernel","repo_url":"https://github.com/gmum/few-shot-hypernets-public","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"few-shot-image-classification","task_name":"Few-Shot Image Classification"},{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"}],"methods":[{"method_slug":"hypernetwork","method_name":"HyperNetwork"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/few-shot-image-classification-on-cub-200-5-1","task":"Few-Shot Image Classification","dataset":"CUB 200 5-way 1-shot","model":"HyperShot","rank_in_archive_order":32,"of":36,"metrics":{"Accuracy":"66.13"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-cub-200-5","task":"Few-Shot Image Classification","dataset":"CUB 200 5-way 5-shot","model":"HyperShot","rank_in_archive_order":30,"of":32,"metrics":{"Accuracy":"80.07"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-mini-1","task":"Few-Shot Image Classification","dataset":"Mini-ImageNet - 1-Shot Learning","model":"HyperShot","rank_in_archive_order":15,"of":16,"metrics":{"Accuracy":"53.18%"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-mini-5","task":"Few-Shot Image Classification","dataset":"Mini-ImageNet-CUB 5-way (1-shot)","model":"HyperShot","rank_in_archive_order":10,"of":12,"metrics":{"Accuracy":"40.03"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-mini-6","task":"Few-Shot Image Classification","dataset":"Mini-ImageNet-CUB 5-way (5-shot)","model":"HyperShot","rank_in_archive_order":7,"of":8,"metrics":{"Accuracy":"58.86"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-mini-3","task":"Few-Shot Image Classification","dataset":"Mini-Imagenet 5-way (5-shot)","model":"HyperShot","rank_in_archive_order":85,"of":95,"metrics":{"Accuracy":"69.62%"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-omniglot","task":"Few-Shot Image Classification","dataset":"OMNIGLOT-EMNIST 5-way (1-shot)","model":"HyperShot","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"80.65"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-image-classification-on-omniglot-2","task":"Few-Shot Image Classification","dataset":"OMNIGLOT-EMNIST 5-way (5-shot)","model":"HyperShot","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"90.81"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-learning-on-mini-imagenet-5-way-1","task":"Few-Shot Learning","dataset":"Mini-Imagenet 5-way (1-shot)","model":"HyperShot","rank_in_archive_order":2,"of":3,"metrics":{"Accuracy":"53.18"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.11378","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}