Methods › General › Attention Mechanisms › Attention › Papers, page 244

Attention Is All You Need

Attention

Papers archive 2025-07-28

archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)

Page 244 of 316: papers 24,301 to 24,400 of 31,583, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Mono vs Multilingual BERT: A Case Study in Hindi and Marathi Named Entity Recognition
  24 Mar 2022 · 0 repositories · arXiv:2203.12907
• Object Memory Transformer for Object Goal Navigation
  24 Mar 2022 · 0 repositories · arXiv:2203.14708
• Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis
  24 Mar 2022 · 2 repositories · arXiv:2203.13278
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 5 pointer-only (licence)
• Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)
  24 Mar 2022 · 2 repositories · arXiv:2203.13366
• Token Dropping for Efficient BERT Pretraining
  24 Mar 2022 · 0 repositories · arXiv:2203.13240
• Bilaterally Slimmable Transformer for Elastic and Efficient Visual Question Answering
  24 Mar 2022 · 1 repository · arXiv:2203.12814
• Transformer Compressed Sensing via Global Image Tokens
  24 Mar 2022 · 1 repository · arXiv:2203.12861
• Transformers Meet Visual Learning Understanding: A Comprehensive Review
  24 Mar 2022 · 0 repositories · arXiv:2203.12944
• Video Instance Segmentation via Multi-scale Spatio-temporal Split Attention Transformer
  24 Mar 2022 · 1 repository · arXiv:2203.13253
• ViT-FOD: A Vision Transformer based Fine-grained Object Discriminator
  24 Mar 2022 · 0 repositories · arXiv:2203.12816
• Stable Optimization for Large Vision Model Based Deep Image Prior in Cone-Beam CT Reconstruction
  23 Mar 2022 · 0 repositories · arXiv:2203.12476
• Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation
  23 Mar 2022 · 1 repository · arXiv:2203.12709
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention
  23 Mar 2022 · 0 repositories · arXiv:2203.12276
• Input-specific Attention Subnetworks for Adversarial Detection
  23 Mar 2022 · 0 repositories · arXiv:2203.12298
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Linearizing Transformer with Key-Value Memory
  23 Mar 2022 · 0 repositories · arXiv:2203.12644
• Mokey: Enabling Narrow Fixed-Point Inference for Out-of-the-Box Floating-Point Transformer Models
  23 Mar 2022 · 0 repositories · arXiv:2203.12758
• Pathways: Asynchronous Distributed Dataflow for ML
  23 Mar 2022 · 0 repositories · arXiv:2203.12533
• Training-free Transformer Architecture Search
  23 Mar 2022 · 1 repository · arXiv:2203.12217
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions
  23 Mar 2022 · 2 repositories · arXiv:2203.12616
• Unsupervised Salient Object Detection with Spectral Cluster Voting
  23 Mar 2022 · 1 repository · arXiv:2203.12614
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 4 pointer-only (licence)
• Visual Prompt Tuning
  23 Mar 2022 · 6 repositories · arXiv:2203.12119
  Syntology official: no sample here; runs from other or unrecorded repositories · 18 ran (of which 12 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 2 where Syntology's instrument failed) · 9 unverified (of 27 harvested samples) · 15 pointer-only (licence)
• A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Framework
  22 Mar 2022 · 0 repositories · arXiv:2203.11856
• Are You Misinformed? A Study of Covid-Related Fake News in Bengali on Facebook
  22 Mar 2022 · 0 repositories · arXiv:2203.11669
• Scalable Video Object Segmentation with Identification Mechanism
  22 Mar 2022 · 2 repositories · arXiv:2203.11442
• BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis
  22 Mar 2022 · 1 repository · arXiv:2203.11702
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Factual Consistency of Multilingual Pretrained Language Models
  22 Mar 2022 · 1 repository · arXiv:2203.11552
• Focal Modulation Networks
  22 Mar 2022 · 9 repositories · arXiv:2203.11926
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers
  22 Mar 2022 · 1 repository · arXiv:2203.11987
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• MetaMorph: Learning Universal Controllers with Transformers
  22 Mar 2022 · 3 repositories · arXiv:2203.11931
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Multi-Modal Learning for AU Detection Based on Multi-Head Fused Transformers
  22 Mar 2022 · 0 repositories · arXiv:2203.11441
• Open-Vocabulary DETR with Conditional Matching
  22 Mar 2022 · 4 repositories · arXiv:2203.11876
  Syntology official (archive's flag): 3 ran · 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 4 pointer-only (licence)
• Self-supervision through Random Segments with Autoregressive Coding (RandSAC)
  22 Mar 2022 · 0 repositories · arXiv:2203.12054
• Transformer based ensemble for emotion detection
  22 Mar 2022 · 0 repositories · arXiv:2203.11899
• Under the Hood of Transformer Networks for Trajectory Forecasting
  22 Mar 2022 · 0 repositories · arXiv:2203.11878
• A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots
  21 Mar 2022 · 1 repository · arXiv:2203.10759
• An Intellectual Property Entity Recognition Method Based on Transformer and Technological Word Information
  21 Mar 2022 · 0 repositories · arXiv:2203.10717
• AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization
  21 Mar 2022 · 0 repositories · arXiv:2203.10945
• Compression of Generative Pre-trained Language Models via Quantization
  21 Mar 2022 · 0 repositories · arXiv:2203.10705
• DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization
  21 Mar 2022 · 2 repositories · arXiv:2203.11239
  Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• Enriching and Characterizing T-Cell Repertoires from 3' Barcoded Single-Cell Whole Transcriptome Amplification Products
  21 Mar 2022 · 0 repositories · arXiv:2203.11266
• GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection
  21 Mar 2022 · 0 repositories · arXiv:2203.10785
• HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization
  21 Mar 2022 · 0 repositories · arXiv:2203.10741
• Masked Discrimination for Self-Supervised Learning on Point Clouds
  21 Mar 2022 · 2 repositories · arXiv:2203.11183
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer
  21 Mar 2022 · 1 repository · arXiv:2203.10981
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• Neural Token Segmentation for High Token-Internal Complexity
  21 Mar 2022 · 0 repositories · arXiv:2203.10845
• ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer
  21 Mar 2022 · 2 repositories · arXiv:2203.10790
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
• Semantic Similarity Computing for Scientific Academic Conferences fused with domain features
  21 Mar 2022 · 0 repositories · arXiv:2203.12593
• Towards Explainable Evaluation Metrics for Natural Language Generation
  21 Mar 2022 · 1 repository · arXiv:2203.11131
• Transformer-based HTR for Historical Documents
  21 Mar 2022 · 1 repository · arXiv:2203.11008
• Build a Robust QA System with Transformer-based Mixture of Experts
  20 Mar 2022 · 1 repository · arXiv:2204.09598
• Cluster & Tune: Boost Cold Start Performance in Text Classification
  20 Mar 2022 · 1 repository · arXiv:2203.10581
  Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
• Delta Keyword Transformer: Bringing Transformers to the Edge through Dynamically Pruned Multi-Head Self-Attention
  20 Mar 2022 · 0 repositories · arXiv:2204.03479
• ECAPA-TDNN for Multi-speaker Text-to-speech Synthesis
  20 Mar 2022 · 1 repository · arXiv:2203.10473
• End-to-End Video Text Spotting with Transformer
  20 Mar 2022 · 1 repository · arXiv:2203.10539
• g2pW: A Conditional Weighted Softmax BERT for Polyphone Disambiguation in Mandarin
  20 Mar 2022 · 1 repository · arXiv:2203.10430
• How does the pre-training objective affect what large language models learn about linguistic properties?
  20 Mar 2022 · 1 repository · arXiv:2203.10415
• Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows
  20 Mar 2022 · 0 repositories · arXiv:2203.10537
• Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild
  20 Mar 2022 · 0 repositories · arXiv:2203.10636
• Unsupervised Domain Adaptation for Nighttime Aerial Tracking
  20 Mar 2022 · 2 repositories · arXiv:2203.10541
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer
  20 Mar 2022 · 1 repository · arXiv:2203.10638
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Vision Transformer with Convolutions Architecture Search
  20 Mar 2022 · 0 repositories · arXiv:2203.10435
• Dependency-based Mixture Language Models
  19 Mar 2022 · 1 repository · arXiv:2203.10256
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
• HIPA: Hierarchical Patch Transformer for Single Image Super Resolution
  19 Mar 2022 · 0 repositories · arXiv:2203.10247
• Learning-by-Narrating: Narrative Pre-Training for Zero-Shot Dialogue Comprehension
  19 Mar 2022 · 1 repository · arXiv:2203.10249
• Multi-Domain Multi-Definition Landmark Localization for Small Datasets
  19 Mar 2022 · 0 repositories · arXiv:2203.10358
• Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense
  19 Mar 2022 · 1 repository · arXiv:2203.10346
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Sequence-to-Sequence Knowledge Graph Completion and Question Answering
  19 Mar 2022 · 1 repository · arXiv:2203.10321
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
• Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Clouds
  19 Mar 2022 · 1 repository · arXiv:2203.10314
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
• AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation
  18 Mar 2022 · 0 repositories · arXiv:2203.10095
• Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators
  18 Mar 2022 · 0 repositories · arXiv:2203.09813
• Local-Global Context Aware Transformer for Language-Guided Video Segmentation
  18 Mar 2022 · 1 repository · arXiv:2203.09773
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• M2TS: Multi-Scale Multi-Modal Approach Based on Transformer for Source Code Summarization
  18 Mar 2022 · 1 repository · arXiv:2203.09707
• Are Vision Transformers Robust to Spurious Correlations?
  17 Mar 2022 · 1 repository · arXiv:2203.09125
• Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning
  17 Mar 2022 · 1 repository · arXiv:2203.09064
  Syntology official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
• Cascade Transformers for End-to-End Person Search
  17 Mar 2022 · 1 repository · arXiv:2203.09642
• Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models
  17 Mar 2022 · 1 repository · arXiv:2203.09397
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists
  17 Mar 2022 · 1 repository · arXiv:2203.09192
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT
  17 Mar 2022 · 1 repository · arXiv:2203.09055
• HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information
  17 Mar 2022 · 0 repositories · arXiv:2203.09629
• Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Image
  17 Mar 2022 · 1 repository · arXiv:2203.09457
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Multilingual Detection of Personal Employment Status on Twitter
  17 Mar 2022 · 1 repository · arXiv:2203.09178
• ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation
  17 Mar 2022 · 1 repository · arXiv:2203.09176
  Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
• On Vision Features in Multimodal Machine Translation
  17 Mar 2022 · 2 repositories · arXiv:2203.09173
  Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation
  17 Mar 2022 · 0 repositories · arXiv:2203.09100
• PreTR: Spatio-Temporal Non-Autoregressive Trajectory Prediction Transformer
  17 Mar 2022 · 0 repositories · arXiv:2203.09293
• Semantic-aligned Fusion Transformer for One-shot Object Detection
  17 Mar 2022 · 0 repositories · arXiv:2203.09093
• SepTr: Separable Transformer for Audio Spectrogram Processing
  17 Mar 2022 · 1 repository · arXiv:2203.09581
• Simulation-Driven Training of Vision Transformers Enabling Metal Segmentation in X-Ray Images
  17 Mar 2022 · 0 repositories · arXiv:2203.09207
• Transframer: Arbitrary Frame Prediction with Generative Models
  17 Mar 2022 · 0 repositories · arXiv:2203.09494
• UNIMO-2: End-to-End Unified Vision-Language Grounded Learning
  17 Mar 2022 · 1 repository · arXiv:2203.09067
• A Squeeze-and-Excitation and Transformer based Cross-task System for Environmental Sound Recognition
  16 Mar 2022 · 0 repositories · arXiv:2203.08350
• AdapLeR: Speeding up Inference by Adaptive Length Reduction
  16 Mar 2022 · 1 repository · arXiv:2203.08991
• DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimation
  16 Mar 2022 · 1 repository · arXiv:2203.08713
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• EDTER: Edge Detection with Transformer
  16 Mar 2022 · 1 repository · arXiv:2203.08566
• KinyaBERT: a Morphology-aware Kinyarwanda Language Model
  16 Mar 2022 · 1 repository · arXiv:2203.08459
  Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples)
• Label Semantics for Few Shot Named Entity Recognition
  16 Mar 2022 · 1 repository · arXiv:2203.08985
• Open Set Recognition using Vision Transformer with an Additional Detection Head
  16 Mar 2022 · 1 repository · arXiv:2203.08441
• The Devil Is in the Details: Window-based Attention for Image Compression
  16 Mar 2022 · 2 repositories · arXiv:2203.08450
  Syntology official (archive's flag): 15 ran · 15 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 3 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples) · 11 pointer-only (licence)
• Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again
  16 Mar 2022 · 1 repository · arXiv:2203.08410
• Towards Practical Certifiable Patch Defense with Vision Transformer
  16 Mar 2022 · 0 repositories · arXiv:2203.08519