{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/instance-enhancement-batch-normalization-an","title":"Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise","arxiv_id":"1908.04008","date":"2019-08-12","proceeding":null,"authors":["Senwei Liang","Zhongzhan Huang","Mingfu Liang","Haizhao Yang"],"abstract":"Batch Normalization (BN)(Ioffe and Szegedy 2015) normalizes the features of an input image via statistics of a batch of images and hence BN will bring the noise to the gradient of the training loss. Previous works indicate that the noise is important for the optimization and generalization of deep neural networks, but too much noise will harm the performance of networks. In our paper, we offer a new point of view that self-attention mechanism can help to regulate the noise by enhancing instance-specific information to obtain a better regularization effect. Therefore, we propose an attention-based BN called Instance Enhancement Batch Normalization (IEBN) that recalibrates the information of each channel by a simple linear transformation. IEBN has a good capacity of regulating noise and stabilizing network training to improve generalization even in the presence of two kinds of noise attacks during training. Finally, IEBN outperforms BN with only a light parameter increment in image classification tasks for different network structures and benchmark datasets.","url_abs":"https://arxiv.org/abs/1908.04008v2","url_pdf":"https://arxiv.org/pdf/1908.04008v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"instance-enhancement-batch-normalization-an","repo_url":"https://github.com/gbup-group/IEBN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"instance-enhancement-batch-normalization-an","repo_url":"https://github.com/Cyril9227/Keras_IEBN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"batch-normalization","method_name":"Batch Normalization"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1908.04008","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.04008"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gbup-group/IEBN","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Cyril9227/Keras_IEBN","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"unverified":7},"by_repo_kind":{"official":{"samples":9,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"gbup-group/IEBN","repo_kind":"official","path":"models/cifar/iebn_resnet.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/models/cifar/iebn_resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"50afa2863ffd9fde","entry":"plot_overlap","repo":"gbup-group/IEBN","repo_kind":"official","path":"utils/logger.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/utils/logger.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"50afa2863ffd9fde"}},{"code_sha256_prefix":"c87e7665fde6cdfc","entry":"colorize","repo":"gbup-group/IEBN","repo_kind":"official","path":"utils/visualize.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/utils/visualize.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c87e7665fde6cdfc"}},{"code_sha256_prefix":"d66f0a3cbb86204c","entry":"gauss","repo":"gbup-group/IEBN","repo_kind":"official","path":"utils/visualize.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/utils/visualize.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d66f0a3cbb86204c"}},{"code_sha256_prefix":"1d6e2edb8832d7b0","entry":"get_mean_and_std","repo":"gbup-group/IEBN","repo_kind":"official","path":"utils/misc.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/utils/misc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d6e2edb8832d7b0"}},{"code_sha256_prefix":"1394422d51c4b126","entry":"make_image","repo":"gbup-group/IEBN","repo_kind":"official","path":"utils/visualize.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/utils/visualize.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1394422d51c4b126"}},{"code_sha256_prefix":"6db40ac24bfe6958","entry":"resnext101","repo":"gbup-group/IEBN","repo_kind":"official","path":"models/imagenet/resnext.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/models/imagenet/resnext.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6db40ac24bfe6958"}},{"code_sha256_prefix":"9e4382fd1664da47","entry":"resnext152","repo":"gbup-group/IEBN","repo_kind":"official","path":"models/imagenet/resnext.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/models/imagenet/resnext.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e4382fd1664da47"}},{"code_sha256_prefix":"8032831473a4283c","entry":"resnext50","repo":"gbup-group/IEBN","repo_kind":"official","path":"models/imagenet/resnext.py","file_url":"https://github.com/gbup-group/IEBN/blob/HEAD/models/imagenet/resnext.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8032831473a4283c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}