{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/upanets-learning-from-the-universal-pixel","title":"UPANets: Learning from the Universal Pixel Attention Networks","arxiv_id":"2103.08640","date":"2021-03-15","proceeding":null,"authors":["Ching-Hsun Tseng","Shin-Jye Lee","Jia-Nan Feng","Shengzhong Mao","Yu-Ping Wu","Jia-Yu Shang","Mou-Chung Tseng","Xiao-jun Zeng"],"abstract":"Among image classification, skip and densely-connection-based networks have dominated most leaderboards. Recently, from the successful development of multi-head attention in natural language processing, it is sure that now is a time of either using a Transformer-like model or hybrid CNNs with attention. However, the former need a tremendous resource to train, and the latter is in the perfect balance in this direction. In this work, to make CNNs handle global and local information, we proposed UPANets, which equips channel-wise attention with a hybrid skip-densely-connection structure. Also, the extreme-connection structure makes UPANets robust with a smoother loss landscape. In experiments, UPANets surpassed most well-known and widely-used SOTAs with an accuracy of 96.47% in Cifar-10, 80.29% in Cifar-100, and 67.67% in Tiny Imagenet. Most importantly, these performances have high parameters efficiency and only trained in one customer-based GPU. We share implementing code of UPANets in https://github.com/hanktseng131415go/UPANets.","url_abs":"https://arxiv.org/abs/2103.08640v2","url_pdf":"https://arxiv.org/pdf/2103.08640v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"upanets-learning-from-the-universal-pixel","repo_url":"https://github.com/hanktseng131415go/UPANets","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":null,"task_name":"GPU"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-classification-on-cifar-10","task":"Image Classification","dataset":"CIFAR-10","model":"UPANets","rank_in_archive_order":110,"of":265,"metrics":{"Percentage correct":"96.47"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-cifar-100","task":"Image Classification","dataset":"CIFAR-100","model":"UPANets","rank_in_archive_order":130,"of":211,"metrics":{"Percentage correct":"80.29"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-tiny-imagenet-1","task":"Image Classification","dataset":"Tiny ImageNet Classification","model":"UPANets","rank_in_archive_order":19,"of":23,"metrics":{"Validation Acc":"67.67"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-tiny-imagenet-2","task":"Image Classification","dataset":"Tiny-ImageNet","model":"UPANets","rank_in_archive_order":1,"of":4,"metrics":{"Top 1 Accuracy":"67.67"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}