{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/regnet-self-regulated-network-for-image","title":"RegNet: Self-Regulated Network for Image Classification","arxiv_id":"2101.00590","date":"2021-01-03","proceeding":null,"authors":["Jing Xu","Yu Pan","Xinglin Pan","Steven Hoi","Zhang Yi","Zenglin Xu"],"abstract":"The ResNet and its variants have achieved remarkable successes in various computer vision tasks. Despite its success in making gradient flow through building blocks, the simple shortcut connection mechanism limits the ability of re-exploring new potentially complementary features due to the additive function. To address this issue, in this paper, we propose to introduce a regulator module as a memory mechanism to extract complementary features, which are further fed to the ResNet. In particular, the regulator module is composed of convolutional RNNs (e.g., Convolutional LSTMs or Convolutional GRUs), which are shown to be good at extracting Spatio-temporal information. We named the new regulated networks as RegNet. The regulator module can be easily implemented and appended to any ResNet architecture. We also apply the regulator module for improving the Squeeze-and-Excitation ResNet to show the generalization ability of our method. Experimental results on three image classification datasets have demonstrated the promising performance of the proposed architecture compared with the standard ResNet, SE-ResNet, and other state-of-the-art architectures.","url_abs":"https://arxiv.org/abs/2101.00590v1","url_pdf":"https://arxiv.org/pdf/2101.00590v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/TrevorIkky/RegNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/2023-MindSpore-1/ms-code-214/blob/main/glore_res/README_CN.md","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":{"status":"ok"}},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/2023-MindSpore-1/ms-code-223/tree/main/ResNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/2023-MindSpore-4/Code-5/tree/main/glore_res","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/2023-MindSpore-4/Code11/tree/main/ssd_resnet34","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/2023-MindSpore-4/Code11/tree/main/ssd_resnet50","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/MindSpore-paper-code-2/code3/tree/main/ssd_resnet50","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/MindSpore-paper-code-2/code400/tree/main/MaskRCNN/maskrcnn_resnet50","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/MindSpore-paper-code-3/code10/tree/main/glore_res","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/code-implementation1/Code7/tree/main/resnet50_adv_pruning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/code-implementation1/Code7/tree/main/resnetv2_50_frn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/code-implementation1/Code9/tree/main/ResNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/keras-team/keras","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"regnet-self-regulated-network-for-image","repo_url":"https://github.com/mindspore-ecosystem/mindcv/blob/main/mindcv/models/regnet.py","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"medical-image-classification","task_name":"Medical Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"bottleneck-residual-block","method_name":"Bottleneck Residual Block"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"kaiming-initialization","method_name":"Kaiming Initialization"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-classification-on-gashissdb","task":"Image Classification","dataset":"GasHisSDB","model":"RegNetY-3.2GF","rank_in_archive_order":7,"of":8,"metrics":{"Accuracy":"97.48","F1-Score":"98.70","Precision":"99.97"},"uses_additional_data":false},{"leaderboard":"/sota/medical-image-classification-on-nct-crc-he","task":"Medical Image Classification","dataset":"NCT-CRC-HE-100K","model":"RegNetY-3.2GF","rank_in_archive_order":3,"of":7,"metrics":{"Accuracy (%)":"95.42","F1-Score":"97.39","Precision":"99.97","Specificity":"99.43"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2101.00590","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}