{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/multi-level-second-order-few-shot-learning","title":"Multi-level Second-order Few-shot Learning","arxiv_id":"2201.05916","date":"2022-01-15","proceeding":null,"authors":["Hongguang Zhang","Hongdong Li","Piotr Koniusz"],"abstract":"We propose a Multi-level Second-order (MlSo) few-shot learning network for supervised or unsupervised few-shot image classification and few-shot action recognition. We leverage so-called power-normalized second-order base learner streams combined with features that express multiple levels of visual abstraction, and we use self-supervised discriminating mechanisms. As Second-order Pooling (SoP) is popular in image recognition, we employ its basic element-wise variant in our pipeline. The goal of multi-level feature design is to extract feature representations at different layer-wise levels of CNN, realizing several levels of visual abstraction to achieve robust few-shot learning. As SoP can handle convolutional feature maps of varying spatial sizes, we also introduce image inputs at multiple spatial scales into MlSo. To exploit the discriminative information from multi-level and multi-scale features, we develop a Feature Matching (FM) module that reweights their respective branches. We also introduce a self-supervised step, which is a discriminator of the spatial level and the scale of abstraction. Our pipeline is trained in an end-to-end manner. With a simple architecture, we demonstrate respectable results on standard datasets such as Omniglot, mini-ImageNet, tiered-ImageNet, Open MIC, fine-grained datasets such as CUB Birds, Stanford Dogs and Cars, and action recognition datasets such as HMDB51, UCF101, and mini-MIT.","url_abs":"https://arxiv.org/abs/2201.05916v1","url_pdf":"https://arxiv.org/pdf/2201.05916v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"multi-level-second-order-few-shot-learning","repo_url":"https://github.com/hongguangzhang/mlso-tmm-master","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"few-shot-action-recognition","task_name":"Few Shot Action Recognition"},{"task_slug":"few-shot-image-classification","task_name":"Few-Shot Image Classification"},{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"few-shot-action-recognition","task_name":"Few-Shot action recognition"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"unsupervised-few-shot-image-classification","task_name":"Unsupervised Few-Shot Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/unsupervised-few-shot-image-classification-on","task":"Unsupervised Few-Shot Image Classification","dataset":"Mini-Imagenet 5-way (1-shot)","model":"U-MlSo+PN","rank_in_archive_order":22,"of":28,"metrics":{"Accuracy":"41.09"},"uses_additional_data":false},{"leaderboard":"/sota/unsupervised-few-shot-image-classification-on-1","task":"Unsupervised Few-Shot Image Classification","dataset":"Mini-Imagenet 5-way (5-shot)","model":"U-MlSo+PN","rank_in_archive_order":24,"of":28,"metrics":{"Accuracy":"55.38"},"uses_additional_data":false},{"leaderboard":"/sota/unsupervised-few-shot-image-classification-on-2","task":"Unsupervised Few-Shot Image Classification","dataset":"Tiered ImageNet 5-way (1-shot)","model":"U-MlSo","rank_in_archive_order":11,"of":12,"metrics":{"Accuracy":"43.01"},"uses_additional_data":false},{"leaderboard":"/sota/unsupervised-few-shot-image-classification-on-3","task":"Unsupervised Few-Shot Image Classification","dataset":"Tiered ImageNet 5-way (5-shot)","model":"U-MlSo","rank_in_archive_order":11,"of":12,"metrics":{"Accuracy":"57.53"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}