{"url":"/method/zero-padded-shortcut-connection","slug":"zero-padded-shortcut-connection","name":"Zero-padded Shortcut Connection","full_name":"Zero-padded Shortcut Connection","full_name_withheld":false,"description_markdown":"A **Zero-padded Shortcut Connection** is a type of [residual connection](https://paperswithcode.com/method/residual-connection) used in the [PyramidNet](https://paperswithcode.com/method/pyramidnet) architecture. For PyramidNets, identity mapping alone cannot be used for a shortcut because the feature map dimension differs among individual residual units. Therefore, only a zero-padded shortcut or projection shortcut can be used for all the residual units. However,  a projection shortcut can hamper information propagation and lead to optimization problems, especially for very deep networks. On the other hand, the zero-padded shortcut avoids the overfitting problem because no additional parameters exist.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"http://arxiv.org/abs/1610.02915v4","title":"Deep Pyramidal Residual Networks","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/dyhan0920/PyramidNet-PyTorch/blob/5a0b32f43d79024a0d9cd2d1851f07e6355daea2/PyramidNet.py#L50","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Skip Connections","url":"/methods/category/skip-connections","pwc_aliases":[]}],"n_papers_tagged":8,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"title":"End-to-End Learning-Based Wireless Image Recognition Using the PyramidNet in Edge Intelligence","date":"2023-03-16","arxiv_id":"2303.09188","n_code_links":0,"syntology":null},{"paper":"/paper/averaging-weights-leads-to-wider-optima-and","title":"Averaging Weights Leads to Wider Optima and Better Generalization","date":"2018-03-14","arxiv_id":"1803.05407","n_code_links":17,"syntology":{"ran":5,"of":9,"unverified":4,"pointer_only":0}},{"paper":"/paper/shakedrop-regularization-for-deep-residual","title":"ShakeDrop Regularization for Deep Residual Learning","date":"2018-02-07","arxiv_id":"1802.02375","n_code_links":5,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":1}},{"paper":null,"title":"ShakeDrop regularization","date":"2018-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/improving-generalization-performance-by","title":"Improving Generalization Performance by Switching from Adam to SGD","date":"2017-12-20","arxiv_id":"1712.07628","n_code_links":6,"syntology":null},{"paper":null,"title":"Pyramidal RoR for Image Classification","date":"2017-10-01","arxiv_id":"1710.00307","n_code_links":0,"syntology":null},{"paper":null,"title":"Deep Pyramidal Residual Networks with Separated Stochastic Depth","date":"2016-12-05","arxiv_id":"1612.01230","n_code_links":0,"syntology":null},{"paper":"/paper/deep-pyramidal-residual-networks","title":"Deep Pyramidal Residual Networks","date":"2016-10-10","arxiv_id":"1610.02915","n_code_links":7,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":0}}],"papers_shown":8,"tasks":[{"task":"/task/image-classification","name":"Image Classification","papers":3},{"task":"/task/classification","name":"General Classification","papers":2},{"task":"/task/image-classification","name":"image-classification","papers":2},{"task":"/task/classification-1","name":"Classification","papers":1},{"task":"/task/decoder","name":"Decoder","papers":1},{"task":"/task/language-modeling","name":"Language Modeling","papers":1},{"task":"/task/language-modelling","name":"Language Modelling","papers":1},{"task":"/task/object-recognition","name":"Object Recognition","papers":1},{"task":"/task/stochastic-optimization","name":"Stochastic Optimization","papers":1}],"tasks_shown":9,"n_tasks":9,"usage_by_year":[{"year":"2016","papers":2},{"year":"2017","papers":2},{"year":"2018","papers":3},{"year":"2023","papers":1}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/zero-padded-shortcut-connection"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}