{"url":"/method/decorrelated-batch-normalization","slug":"decorrelated-batch-normalization","name":"Decorrelated Batch Normalization","full_name":"Decorrelated Batch Normalization","full_name_withheld":false,"description_markdown":"**Decorrelated Batch Normalization (DBN)** \r\nis a normalization technique which not just centers and scales activations but whitens them. ZCA whitening instead of [PCA](https://paperswithcode.com/method/pca) whitening is employed since PCA whitening causes a problem called *stochastic axis swapping*, which is detrimental to learning.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Decorrelated Batch Normalization","paper":"/paper/decorrelated-batch-normalization","first_author":"Lei Huang","n_authors":4,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/decorrelated-batch-normalization"},"source":{"url":"http://arxiv.org/abs/1804.08450v1","title":"Decorrelated Batch Normalization","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/bhneo/decorrelated_bn/blob/ded9279387d62209c7fd4d1d21918431c0d6e96d/common/normalization.py#L16","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Normalization","url":"/methods/category/normalization","pwc_aliases":[]}],"n_papers_tagged":4,"archive_num_papers":4,"papers_newest_first":[{"paper":"/paper/orthogonal-svd-covariance-conditioning-and","title":"Orthogonal SVD Covariance Conditioning and Latent Disentanglement","date":"2022-12-11","arxiv_id":"2212.05599","n_code_links":1,"syntology":null},{"paper":"/paper/improving-covariance-conditioning-of-the-svd","title":"Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality","date":"2022-07-05","arxiv_id":"2207.02119","n_code_links":1,"syntology":{"ran":0,"of":1,"unverified":1,"pointer_only":0}},{"paper":"/paper/iterative-normalization-beyond","title":"Iterative Normalization: Beyond Standardization towards Efficient Whitening","date":"2019-04-06","arxiv_id":"1904.03441","n_code_links":5,"syntology":{"ran":11,"of":14,"unverified":3,"pointer_only":1}},{"paper":"/paper/decorrelated-batch-normalization","title":"Decorrelated Batch Normalization","date":"2018-04-23","arxiv_id":"1804.08450","n_code_links":6,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":1}}],"papers_shown":4,"tasks":[{"task":"/task/disentanglement","name":"Disentanglement","papers":1},{"task":"/task/robust-object-detection","name":"Robust Object Detection","papers":1}],"tasks_shown":2,"n_tasks":2,"usage_by_year":[{"year":"2018","papers":1},{"year":"2019","papers":1},{"year":"2022","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/decorrelated-batch-normalization"},"syntology_read_at":"2026-09-25T09:33:49+00:00"}