{"url":"/method/residual-block","slug":"residual-block","name":"Residual Block","full_name":"Residual Block","full_name_withheld":false,"description_markdown":"**Residual Blocks** are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced as part of the [ResNet](https://paperswithcode.com/method/resnet) architecture.\r\n \r\nFormally, denoting the desired underlying mapping as $\\mathcal{H}({x})$, we let the stacked nonlinear layers fit another mapping of $\\mathcal{F}({x}):=\\mathcal{H}({x})-{x}$. The original mapping is recast into $\\mathcal{F}({x})+{x}$. The $\\mathcal{F}({x})$ acts like a residual, hence the name 'residual block'.\r\n\r\nThe intuition is that it is easier to optimize the residual mapping than to optimize the original, unreferenced mapping. To the extreme, if an identity mapping were optimal, it would be easier to push the residual to zero than to fit an identity mapping by a stack of nonlinear layers. Having skip connections allows the network to more easily learn identity-like mappings.\r\n\r\nNote that in practice, [Bottleneck Residual Blocks](https://paperswithcode.com/method/bottleneck-residual-block) are used for deeper ResNets, such as ResNet-50 and ResNet-101, as these bottleneck blocks are less computationally intensive.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Deep Residual Learning for Image Recognition","paper":"/paper/deep-residual-learning-for-image-recognition","first_author":"Kaiming He","n_authors":4,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/deep-residual-learning-for-image-recognition"},"source":{"url":"http://arxiv.org/abs/1512.03385v1","title":"Deep Residual Learning for Image Recognition","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/pytorch/vision/blob/1aef87d01eec2c0989458387fa04baebcc86ea7b/torchvision/models/resnet.py#L35","code_snippet_url_on_a_code_host":true,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Image Model Blocks","url":"/methods/category/image-model-blocks","pwc_aliases":[]},{"area":"General","area_id":"general","collection":"Skip Connection Blocks","url":"/methods/category/skip-connection-blocks","pwc_aliases":[]}],"n_papers_tagged":2807,"archive_num_papers":2807,"papers_newest_first":[{"paper":null,"title":"MTSIC: Multi-stage Transformer-based GAN for Spectral Infrared Image Colorization","date":"2025-06-21","arxiv_id":"2506.17540","n_code_links":0,"syntology":null},{"paper":null,"title":"SpikeSMOKE: Spiking Neural Networks for Monocular 3D Object Detection with Cross-Scale Gated Coding","date":"2025-06-09","arxiv_id":"2506.07737","n_code_links":0,"syntology":null},{"paper":null,"title":"Low-Complexity Transform Adjustments For Video Coding","date":"2025-05-29","arxiv_id":"2505.23618","n_code_links":0,"syntology":null},{"paper":null,"title":"Calibrated Value-Aware Model Learning with Stochastic Environment Models","date":"2025-05-28","arxiv_id":"2505.22772","n_code_links":0,"syntology":null},{"paper":null,"title":"Multipath cycleGAN for harmonization of paired and unpaired low-dose lung computed tomography reconstruction kernels","date":"2025-05-28","arxiv_id":"2505.22568","n_code_links":0,"syntology":null},{"paper":null,"title":"Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing","date":"2025-05-27","arxiv_id":"2505.20746","n_code_links":0,"syntology":null},{"paper":null,"title":"Anatomy-Guided Multitask Learning for MRI-Based Classification of Placenta Accreta Spectrum and its Subtypes","date":"2025-05-23","arxiv_id":"2505.17484","n_code_links":0,"syntology":null},{"paper":null,"title":"3D Reconstruction from Sketches","date":"2025-05-20","arxiv_id":"2505.14621","n_code_links":0,"syntology":null},{"paper":null,"title":"Towards Generating Realistic Underwater Images","date":"2025-05-20","arxiv_id":"2505.14296","n_code_links":0,"syntology":null},{"paper":null,"title":"Super-Resolution Generative Adversarial Networks based Video Enhancement","date":"2025-05-14","arxiv_id":"2505.10589","n_code_links":0,"syntology":null},{"paper":null,"title":"A Deep Learning-Driven Inhalation Injury Grading Assistant Using Bronchoscopy Images","date":"2025-05-13","arxiv_id":"2505.08517","n_code_links":0,"syntology":null},{"paper":null,"title":"Predicting Diabetes Using Machine Learning: A Comparative Study of Classifiers","date":"2025-05-11","arxiv_id":"2505.07036","n_code_links":0,"syntology":null},{"paper":null,"title":"MRI motion correction via efficient residual-guided denoising diffusion probabilistic models","date":"2025-05-06","arxiv_id":"2505.03498","n_code_links":0,"syntology":null},{"paper":null,"title":"Optimization of Module Transferability in Single Image Super-Resolution: Universality Assessment and Cycle Residual Blocks","date":"2025-05-06","arxiv_id":"2505.03522","n_code_links":0,"syntology":null},{"paper":null,"title":"Revolutionizing Brain Tumor Imaging: Generating Synthetic 3D FA Maps from T1-Weighted MRI using CycleGAN Models","date":"2025-05-06","arxiv_id":"2505.03662","n_code_links":0,"syntology":null},{"paper":null,"title":"Lesion-Aware Generative Artificial Intelligence for Virtual Contrast-Enhanced Mammography in Breast Cancer","date":"2025-05-05","arxiv_id":"2505.03018","n_code_links":0,"syntology":null},{"paper":null,"title":"ClearVision: Leveraging CycleGAN and SigLIP-2 for Robust All-Weather Classification in Traffic Camera Imagery","date":"2025-04-28","arxiv_id":"2504.19684","n_code_links":0,"syntology":null},{"paper":null,"title":"Mitigating Timbre Leakage with Universal Semantic Mapping Residual Block for Voice Conversion","date":"2025-04-11","arxiv_id":"2504.08524","n_code_links":0,"syntology":null},{"paper":null,"title":"Camera Model Identification with SPAIR-Swin and Entropy based Non-Homogeneous Patches","date":"2025-03-28","arxiv_id":"2503.22120","n_code_links":0,"syntology":null},{"paper":"/paper/tune-it-up-music-genre-transfer-and","title":"Tune It Up: Music Genre Transfer and Prediction","date":"2025-03-27","arxiv_id":"2503.22008","n_code_links":1,"syntology":null},{"paper":"/paper/iterative-optimal-attention-and-local-model","title":"Iterative Optimal Attention and Local Model for Single Image Rain Streak Removal","date":"2025-03-20","arxiv_id":"2503.16165","n_code_links":1,"syntology":null},{"paper":"/paper/exploiting-diffusion-prior-for-real-world-1","title":"Exploiting Diffusion Prior for Real-World Image Dehazing with Unpaired Training","date":"2025-03-19","arxiv_id":"2503.15017","n_code_links":1,"syntology":null},{"paper":null,"title":"AI-Driven Diabetic Retinopathy Diagnosis Enhancement through Image Processing and Salp Swarm Algorithm-Optimized Ensemble Network","date":"2025-03-18","arxiv_id":"2503.14209","n_code_links":0,"syntology":null},{"paper":null,"title":"Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin","date":"2025-03-18","arxiv_id":"2503.15555","n_code_links":0,"syntology":null},{"paper":null,"title":"CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy","date":"2025-03-14","arxiv_id":"2503.11266","n_code_links":0,"syntology":null},{"paper":null,"title":"Feature Fusion Attention Network with CycleGAN for Image Dehazing, De-Snowing and De-Raining","date":"2025-03-08","arxiv_id":"2503.06107","n_code_links":0,"syntology":null},{"paper":"/paper/generalizable-image-repair-for-robust-visual","title":"Generalizable Image Repair for Robust Visual Autonomous Racing","date":"2025-03-07","arxiv_id":"2503.05911","n_code_links":1,"syntology":null},{"paper":"/paper/mri-super-resolution-reconstruction-using","title":"MRI super-resolution reconstruction using efficient diffusion probabilistic model with residual shifting","date":"2025-03-03","arxiv_id":"2503.01576","n_code_links":1,"syntology":null},{"paper":null,"title":"Cross Modality Medical Image Synthesis for Improving Liver Segmentation","date":"2025-03-02","arxiv_id":"2503.00945","n_code_links":0,"syntology":null},{"paper":null,"title":"Development of an Unpaired Deep Neural Network for Synthesizing X-ray Fluoroscopic Images from Digitally Reconstructed Tomography in Image Guided Radiotherapy","date":"2025-03-01","arxiv_id":"2503.00665","n_code_links":0,"syntology":null}],"papers_shown":30,"tasks":[{"task":"/task/image-classification","name":"Image Classification","papers":361},{"task":"/task/image-classification","name":"image-classification","papers":265},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":228},{"task":"/task/object-detection","name":"Object Detection","papers":202},{"task":"/task/classification","name":"General Classification","papers":182},{"task":"/task/object-detection-1","name":"object-detection","papers":169},{"task":"/task/classification-1","name":"Classification","papers":147},{"task":"/task/segmentation","name":"Segmentation","papers":146},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":139},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":135},{"task":"/task/translation","name":"Translation","papers":127},{"task":"/task/self-supervised-learning","name":"Self-Supervised Learning","papers":126},{"task":"/task/representation-learning","name":"Representation Learning","papers":124},{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":123},{"task":"/task/image-generation","name":"Image Generation","papers":121},{"task":"/task/image-to-image-translation","name":"Image-to-Image Translation","papers":100},{"task":"/task/object","name":"Object","papers":87},{"task":null,"name":"Generative Adversarial Network","papers":84},{"task":"/task/super-resolution","name":"Super-Resolution","papers":83},{"task":"/task/deep-learning","name":"Deep Learning","papers":80}],"tasks_shown":20,"n_tasks":922,"usage_by_year":[{"year":"2015","papers":2},{"year":"2016","papers":35},{"year":"2017","papers":117},{"year":"2018","papers":236},{"year":"2019","papers":384},{"year":"2020","papers":523},{"year":"2021","papers":500},{"year":"2022","papers":437},{"year":"2023","papers":426},{"year":"2024","papers":104},{"year":"2025","papers":43}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/residual-block"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}