Deep Attention

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 45 papers with code (109 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• PREDATOR: Registration of 3D Point Clouds with Low Overlap
  25 Nov 2020 5 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  We introduce PREDATOR, a model for pairwise point-cloud registration with deep attention to the overlap region.
• Learning to Segment from Scribbles using Multi-scale Adversarial Attention Gates
  2 Jul 2020 3 repositories listed
  We evaluated our model on several medical (ACDC, LVSC, CHAOS) and non-medical (PPSS) datasets, and we report performance levels matching those achieved by models trained with fully annotated segmentation masks.
• Deep Attention Recurrent Q-Network
  5 Dec 2015 3 repositories listed
  A deep learning approach to reinforcement learning led to a general learner able to train on visual input to play a variety of arcade games at the human and superhuman levels.
• Restoring Snow-Degraded Single Images With Wavelet in Vision Transformer
  11 Sep 2023 2 repositories listed
  In our experiments, we evaluated the performance of our model on the popular SRRS, SNOW100K, and CSD datasets, respectively.
• Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing
  23 Dec 2020 2 repositories listed
  We present BRIDGE, a powerful sequential architecture for modeling dependencies between natural language questions and relational databases in cross-DB semantic parsing.
• Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks
  23 Sep 2020 2 repositories listed
  Deep learning applied to weather forecasting has started gaining popularity because of the progress achieved by data-driven models.
• Deep Attention Aware Feature Learning for Person Re-Identification
  1 Mar 2020 2 repositories listed
  Visual attention has proven to be effective in improving the performance of person re-identification.
• Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models
  27 Nov 2019 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  We introduce a new local sparse attention layer that preserves two-dimensional geometry and locality.
• Processing Megapixel Images with Deep Attention-Sampling Models
  3 May 2019 2 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  We show that sampling from the attention distribution results in an unbiased estimator of the full model with minimal variance, and we derive an unbiased estimator of the gradient that we use to train our model…
• Bayes optimal learning of attention-indexed models
  2 Jun 2025 1 repository listed
  We introduce the attention-indexed model (AIM), a theoretical framework for analyzing learning in deep attention layers.
• Multi-modal Collaborative Optimization and Expansion Network for Event-assisted Single-eye Expression Recognition
  17 May 2025 1 repository listed
  In this paper, we proposed a Multi-modal Collaborative Optimization and Expansion Network (MCO-E Net), to use event modalities to resist challenges such as low light, high exposure, and high dynamic range in single-eye…
• An Ensemble Framework for Probabilistic Short-Term Load Forecasting Based on BiTCN and Deep Attention Networks
  25 Feb 2025 1 repository listed
  Probabilistic load forecasting is crucial for modern energy systems, providing point forecasts and uncertainty quantification to enhance decision-making and grid reliability.
• Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
  2 Feb 2025 1 repository listed
  In this manuscript, we study the learning of deep attention neural networks, defined as the composition of multiple self-attention layers, with tied and low-rank weights.
• SGFormer: Single-Layer Graph Transformers with Approximation-Free Linear Complexity
  13 Sep 2024 1 repository listed
  Learning representations on large graphs is a long-standing challenge due to the inter-dependence nature.
• AllWeatherNet:Unified Image Enhancement for Autonomous Driving under Adverse Weather and Lowlight-conditions
  3 Sep 2024 1 repository listed
  AllWeather-Net effectively transforms images into normal weather and daytime scenes, demonstrating superior image enhancement results and subsequently enhancing the performance of semantic segmentation, with up to a 5.
• Geometry of Lightning Self-Attention: Identifiability and Dimension
  30 Aug 2024 1 repository listed
  We consider function spaces defined by self-attention networks without normalization, and theoretically analyze their geometry.
• Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment
  12 Jul 2024 1 repository listed
  We introduce an AV centric spatiotemporal attention encoding (STAE) mechanism for learning the dynamic interactions with different surrounding vehicles.
• Deep Attention Q-Network for Personalized Treatment Recommendation
  4 Jul 2023 1 repository listed
  Tailoring treatment for individual patients is crucial yet challenging in order to achieve optimal healthcare outcomes.
• Towards Deep Attention in Graph Neural Networks: Problems and Remedies
  4 Jun 2023 1 repository listed
  AERO-GNN provably mitigates the proposed problems of deep graph attention, which is further empirically demonstrated with (a) its adaptive and less smooth attention functions and (b) higher performance at deep layers…
• AIA: Attention in Attention Within Collaborate Domains
  7 Oct 2022 1 repository listed
  Attention mechanisms can effectively improve the performance of the mobile networks with a limited computational complexity cost.
• Open-CyKG: An Open Cyber Threat Intelligence Knowledge Graph
  5 Dec 2021 1 repository listed
  Instant analysis of cybersecurity reports is a fundamental challenge for security experts as an immeasurable amount of cyber information is generated on a daily basis, which necessitates automated information extraction…
• Deep Attention-guided Graph Clustering with Dual Self-supervision
  10 Nov 2021 1 repository listed
  Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting…
• Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Images
  22 Sep 2021 1 repository listed
  Annotating cancerous regions in whole-slide images (WSIs) of pathology samples plays a critical role in clinical diagnosis, biomedical research, and machine learning algorithms development.
• HIT - A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation
  1 Aug 2021 1 repository listed
• Thermal Image Super-Resolution Using Second-Order Channel Attention with Varying Receptive Fields
  30 Jul 2021 1 repository listed
  Specifically, we explore how to effectively attend to contrasting receptive fields (RFs) where increasing the RFs of a network can be computationally expensive.
• Grid Partitioned Attention: Efficient TransformerApproximation with Inductive Bias for High Resolution Detail Generation
  8 Jul 2021 1 repository listed
  Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation.
• HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation
  30 May 2021 1 repository listed
  In this paper, we propose HIT, a robust representation learning method for code-mixed texts.
• Lipschitz Normalization for Self-Attention Layers with Application to Graph Neural Networks
  8 Mar 2021 1 repository listed
  To address this issue, we derive a theoretical analysis of the Lipschitz continuity of attention modules and introduce LipschitzNorm, a simple and parameter-free normalization for self-attention mechanisms that enforces…
• Hard-Attention for Scalable Image Classification
  20 Feb 2021 1 repository listed
  Can we leverage high-resolution information without the unsustainable quadratic complexity to input scale?
• End-to-end Prostate Cancer Detection in bpMRI via 3D CNNs: Effects of Attention Mechanisms, Clinical Priori and Decoupled False Positive Reduction
  8 Jan 2021 1 repository listed
  We present a multi-stage 3D computer-aided detection and diagnosis (CAD) model for automated localization of clinically significant prostate cancer (csPCa) in bi-parametric MR imaging (bpMRI).

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.