Methods › General › Skip Connection Blocks › Reversible Residual Block
Reversible Residual Block
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Reversible Residual Blocks are skip-connection blocks that learn reversible residual functions with reference to the layer inputs. It is proposed as part of the RevNet CNN architecture. Units in each layer are partitioned into two groups, denoted x₁ and x₂; the authors find what works best is partitioning the channels. Each reversible block takes inputs (x₁, x₂) and produces outputs (y₁, y₂) according to the following additive coupling rules – inspired by the transformation in NICE (nonlinear independent components estimation) – and residual functions F and G analogous to those in standard ResNets:
y₁ = x₁ + F(x₂) y₂ = x₂ + G(y₁)
Each layer’s activations can be reconstructed from the next layer’s activations as follows:
x₂ = y₂ − G(y₁) x₁ = y₁ − F(x₂)
Papers archive 2025-07-28
29 shown of 29, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Cardioformer: Advancing AI in ECG Analysis with Multi-Granularity Patching and ResNet 8 May 2025 · 1 repository · arXiv:2505.05538
-
Fast-Powerformer: A Memory-Efficient Transformer for Accurate Mid-Term Wind Power Forecasting 15 Apr 2025 · 0 repositories · arXiv:2504.10923
-
ReFormer: Generating Radio Fakes for Data Augmentation 31 Dec 2024 · 0 repositories · arXiv:2501.00282
-
GLMHA A Guided Low-rank Multi-Head Self-Attention for Efficient Image Restoration and Spectral Reconstruction 1 Oct 2024 · 0 repositories · arXiv:2410.00380
-
Masked Face Recognition with Generative-to-Discriminative Representations 27 May 2024 · 0 repositories · arXiv:2405.16761
-
A novel transformer-based approach for soil temperature prediction 20 Nov 2023 · 0 repositories · arXiv:2311.11626
-
Diffusion Models Beat GANs on Image Classification 17 Jul 2023 · 1 repository · arXiv:2307.08702
-
LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension 16 Dec 2022 · 0 repositories · arXiv:2212.08204
-
FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecasting 2 Dec 2022 · 1 repository · arXiv:2212.01209
-
Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting 28 May 2022 · 2 repositories · arXiv:2205.14415
-
Conditional Injective Flows for Bayesian Imaging 15 Apr 2022 · 1 repository · arXiv:2204.07664
-
Discovering material information using hierarchical Reformer model on financial regulatory filings 28 Mar 2022 · 0 repositories · arXiv:2204.05979
-
Dynamic Token Normalization Improves Vision Transformers 5 Dec 2021 · 1 repository · arXiv:2112.02624Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
Level set learning with pseudo-reversible neural networks for nonlinear dimension reduction in function approximation 2 Dec 2021 · 2 repositories · arXiv:2112.01438
-
End-to-End User Behavior Retrieval in Click-Through RatePrediction Model 10 Aug 2021 · 1 repository · arXiv:2108.04468
-
ReFormer: The Relational Transformer for Image Captioning 29 Jul 2021 · 1 repository · arXiv:2107.14178
-
Multi-split Reversible Transformers Can Enhance Neural Machine Translation 1 Apr 2021 · 0 repositories
-
A Practical Survey on Faster and Lighter Transformers 26 Mar 2021 · 0 repositories · arXiv:2103.14636
-
ReAssert: Deep Learning for Assert Generation 19 Nov 2020 · 0 repositories · arXiv:2011.09784
-
Learning to Unknot 28 Oct 2020 · 0 repositories · arXiv:2010.16263
-
Robustification of Segmentation Models Against Adversarial Perturbations In Medical Imaging 23 Sep 2020 · 0 repositories · arXiv:2009.11090
-
Efficient Transformers: A Survey 14 Sep 2020 · 0 repositories · arXiv:2009.06732
-
Object Segmentation Without Labels with Large-Scale Generative Models 8 Jun 2020 · 1 repository · arXiv:2006.04988
-
Neural Machine Translation with Joint Representation 16 Feb 2020 · 1 repository · arXiv:2002.06546
-
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN 31 Jan 2020 · 0 repositories · arXiv:2001.11761
-
Reformer: The Efficient Transformer 13 Jan 2020 · 10 repositories · arXiv:2001.04451Syntology ran 6 of 8 samples · 2 unverified
-
Large Scale Adversarial Representation Learning 4 Jul 2019 · 4 repositories · arXiv:1907.02544Syntology ran 0 of 3 samples · 3 unverified
-
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations 27 Oct 2017 · 0 repositories · arXiv:1710.10121
-
The Reversible Residual Network: Backpropagation Without Storing Activations 14 Jul 2017 · 9 repositories · arXiv:1707.04585Syntology ran 4 of 4 samples · 0 unverified
Tasks archive 2025-07-28
20 shown of 74 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections