Methods › Computer Vision › Image Model Blocks › Axial Attention
Axial Attention
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Axial Attention is a simple generalization of self-attention that naturally aligns with the multiple dimensions of the tensors in both the encoding and the decoding settings. It was first proposed in CCNet [1] named as criss-cross attention, which harvests the contextual information of all the pixels on its criss-cross path. By taking a further recurrent operation, each pixel can finally capture the full-image dependencies. Ho et al [2] extents CCNet to process multi-dimensional data. The proposed structure of the layers allows for the vast majority of the context to be computed in parallel during decoding without introducing any independence assumptions. It serves as the basic building block for developing self-attention-based autoregressive models for high-dimensional data tensors, e.g., Axial Transformers. It has been applied in AlphaFold [3] for interpreting protein sequences.
[1] Zilong Huang, Xinggang Wang, Lichao Huang, Chang Huang, Yunchao Wei, Wenyu Liu. CCNet: Criss-Cross Attention for Semantic Segmentation. ICCV, 2019.
[2] Jonathan Ho, Nal Kalchbrenner, Dirk Weissenborn, Tim Salimans. arXiv:1912.12180
[3] Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, Tunyasuvunakool K, Bates R, Žídek A, Potapenko A, Bridgland A. Highly accurate protein structure prediction with AlphaFold. Nature. 2021 Jul 15:1-1.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: axial attention module; Tropical Axial Attention; TC-ATTENTION; SS-Attention; VC-Attention; TF-ATTENTION; EL-Attention; Attention-JSD.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 59 · with a code link: 21 · where Syntology ran a sample: 5 (4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 59 tagged: 4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 59 of 59, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Universal Biological Sequence Reranking for Improved De Novo Peptide Sequencing 23 May 2025 · 1 repository · arXiv:2505.17552
-
UNet with Axial Transformer : A Neural Weather Model for Precipitation Nowcasting 28 Apr 2025 · 1 repository · arXiv:2504.19408
-
MATEY: multiscale adaptive foundation models for spatiotemporal physical systems 29 Dec 2024 · 0 repositories · arXiv:2412.20601
-
Ensemble Learning and 3D Pix2Pix for Comprehensive Brain Tumor Analysis in Multimodal MRI 16 Dec 2024 · 0 repositories · arXiv:2412.11849
-
ParseCaps: An Interpretable Parsing Capsule Network for Medical Image Diagnosis 3 Nov 2024 · 0 repositories · arXiv:2411.01564
-
Axial Attention Transformer Networks: A New Frontier in Breast Cancer Detection 18 Sep 2024 · 0 repositories · arXiv:2409.12347
-
EFCNet: Every Feature Counts for Small Medical Object Segmentation 26 Jun 2024 · 0 repositories · arXiv:2406.18201
-
Progressive Frequency-Aware Network for Laparoscopic Image Desmoking 19 Dec 2023 · 1 repository · arXiv:2312.12023
-
MCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention 14 Dec 2023 · 1 repository · arXiv:2312.08866
-
Integrated Image and Location Analysis for Wound Classification: A Deep Learning Approach 23 Aug 2023 · 1 repository · arXiv:2308.11877
-
Scalable Deep Learning for RNA Secondary Structure Prediction 14 Jul 2023 · 1 repository · arXiv:2307.10073Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Axial-LOB: High-Frequency Trading with Axial Attention 4 Dec 2022 · 1 repository · arXiv:2212.01807
-
Revisiting Image Pyramid Structure for High Resolution Salient Object Detection 20 Sep 2022 · 3 repositories · arXiv:2209.09475Syntology official (archive's flag): 8 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
-
GEM-2: Next Generation Molecular Property Prediction Network by Modeling Full-range Many-body Interactions 11 Aug 2022 · 1 repository · arXiv:2208.05863
-
CANet: Channel Extending and Axial Attention Catching Network for Multi-structure Kidney Segmentation 10 Aug 2022 · 0 repositories · arXiv:2208.05241
-
CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers 5 Jul 2022 · 2 repositories · arXiv:2207.02202Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
DAtRNet: Disentangling Fashion Attribute Embedding for Substitute Item Retrieval 1 Jun 2022 · 0 repositories
-
Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation 21 Mar 2022 · 1 repository · arXiv:2203.10900
-
Extending nn-UNet for brain tumor segmentation 9 Dec 2021 · 1 repository · arXiv:2112.04653
-
Modelling and Analysis of Magnetic Fields from Skeletal Muscle for Valuable Physiological Measurements 5 Apr 2021 · 0 repositories · arXiv:2104.02036
-
Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples 29 Mar 2021 · 0 repositories · arXiv:2103.15795
-
Motion Estimation for Optical Coherence Elastography Using Signal Phase and Intensity 19 Mar 2021 · 0 repositories · arXiv:2103.10784
-
Missing Cone Artifacts Removal in ODT using Unsupervised Deep Learning in Projection Domain 16 Mar 2021 · 0 repositories · arXiv:2103.09022
-
A learning-based view extrapolation method for axial super-resolution 11 Mar 2021 · 0 repositories · arXiv:2103.06510
-
Deep learning can differentiate IDH-mutant from IDH-wild type GBM 24 Feb 2021 · 0 repositories · arXiv:2102.13205
-
Axial Residual Networks for CycleGAN-based Voice Conversion 16 Feb 2021 · 0 repositories · arXiv:2102.08075
-
Colorization Transformer 8 Feb 2021 · 2 repositories · arXiv:2102.04432
-
Channelized Axial Attention for Semantic Segmentation -- Considering Channel Relation within Spatial Attention for Semantic Segmentation 19 Jan 2021 · 1 repository · arXiv:2101.07434
-
Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks 19 Jan 2021 · 1 repository · arXiv:2101.07653
-
VideoGen: Generative Modeling of Videos using VQ-VAE and Transformers 1 Jan 2021 · 0 repositories
-
A Multi-View Dynamic Fusion Framework: How to Improve the Multimodal Brain Tumor Segmentation from Multi-Views? 21 Dec 2020 · 0 repositories · arXiv:2012.11211
-
Virtual Source Synthetic Aperture for Accurate Lateral Displacement Estimation in Ultrasound Elastography 19 Dec 2020 · 0 repositories · arXiv:2012.10562
-
Deep Dose Plugin Towards Real-time Monte Carlo Dose Calculation Through a Deep Learning based Denoising Algorithm 30 Nov 2020 · 0 repositories · arXiv:2011.14959
-
MRI Images Analysis Method for Early Stage Alzheimer's Disease Detection 27 Nov 2020 · 0 repositories · arXiv:2012.00830
-
Accurate and Rapid Diagnosis of COVID-19 Pneumonia with Batch Effect Removal of Chest CT-Scans and Interpretable Artificial Intelligence 23 Nov 2020 · 0 repositories · arXiv:2011.11736
-
Deep Sequential Learning for Cervical Spine Fracture Detection on Computed Tomography Imaging 26 Oct 2020 · 0 repositories · arXiv:2010.13336
-
Recurrent neural network-based volumetric fluorescence microscopy 21 Oct 2020 · 0 repositories · arXiv:2010.10781
-
Efficient and high accuracy 3-D OCT angiography motion correction in pathology 14 Oct 2020 · 0 repositories · arXiv:2010.06931
-
Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy 12 Oct 2020 · 0 repositories · arXiv:2010.05382
-
Learning an optimal PSF-pair for ultra-dense 3D localization microscopy 29 Sep 2020 · 1 repository · arXiv:2009.14303
-
Anisotropic 3D Multi-Stream CNN for Accurate Prostate Segmentation from Multi-Planar MRI 23 Sep 2020 · 1 repository · arXiv:2009.11120
-
Reconstruct high-resolution multi-focal plane images from a single 2D wide field image 21 Sep 2020 · 0 repositories · arXiv:2009.09574
-
Improving axial resolution in SIM using deep learning 4 Sep 2020 · 1 repository · arXiv:2009.02264
-
Reinforced Axial Refinement Network for Monocular 3D Object Detection 31 Aug 2020 · 0 repositories · arXiv:2008.13748
-
Comparative performance analysis of the ResNet backbones of Mask RCNN to segment the signs of COVID-19 in chest CT scans 21 Aug 2020 · 0 repositories · arXiv:2008.09713
-
Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Data 4 Aug 2020 · 0 repositories · arXiv:2008.01362
-
Polarized Optical-Flow Gyroscope 1 Aug 2020 · 0 repositories
-
MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstruction 24 Jul 2020 · 0 repositories · arXiv:2007.13559
-
Multi-Subspace Neural Network for Image Recognition 17 Jun 2020 · 0 repositories · arXiv:2006.09618
-
MetNet: A Neural Weather Model for Precipitation Forecasting 24 Mar 2020 · 2 repositories · arXiv:2003.12140Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Single-shot autofocusing of microscopy images using deep learning 21 Mar 2020 · 0 repositories · arXiv:2003.09585
-
A Deep learning Approach to Generate Contrast-Enhanced Computerised Tomography Angiography without the Use of Intravenous Contrast Agents 2 Mar 2020 · 0 repositories · arXiv:2003.01223
-
Fully-automated Body Composition Analysis in Routine CT Imaging Using 3D Semantic Segmentation Convolutional Neural Networks 25 Feb 2020 · 0 repositories · arXiv:2002.10776
-
Automatic Frame Selection using CNN in Ultrasound Elastography 17 Feb 2020 · 0 repositories · arXiv:2002.06734
-
Fast and robust multiplane single molecule localization microscopy using deep neural network 7 Jan 2020 · 0 repositories · arXiv:2001.01893
-
DeepFocus: a Few-Shot Microscope Slide Auto-Focus using a Sample Invariant CNN-based Sharpness Function 2 Jan 2020 · 1 repository · arXiv:2001.00667
-
Improved Spectral Imaging Microscopy for Cultural Heritage through Oblique Illumination 1 Jan 2020 · 0 repositories · arXiv:2001.00817
-
Volumetric Lung Nodule Segmentation using Adaptive ROI with Multi-View Residual Learning 31 Dec 2019 · 0 repositories · arXiv:1912.13335
-
Axial Attention in Multidimensional Transformers 20 Dec 2019 · 3 repositories · arXiv:1912.12180Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 91 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Segmentation | 11 |
| Semantic Segmentation | 7 |
| Deep Learning | 5 |
| Generative Adversarial Network | 4 |
| Image Segmentation | 4 |
| Computational Efficiency | 3 |
| Decoder | 3 |
| Image Classification | 3 |
| Medical Image Segmentation | 3 |
| Object Detection | 3 |
| SSIM | 3 |
| Tumor Segmentation | 3 |
| image-classification | 3 |
| 3D Object Detection | 2 |
| Brain Tumor Segmentation | 2 |
| Diagnostic | 2 |
| Image Reconstruction | 2 |
| Motion Estimation | 2 |
| Position | 2 |
| Relation | 2 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections