Methods › General › Attention Mechanisms › Attention › Papers, page 245
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 245 of 316: papers 24,401 to 24,500 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Unsupervised Semantic Segmentation by Distilling Feature Correspondences 16 Mar 2022 · 3 repositories · arXiv:2203.08414Syntology official (archive's flag): 3 ran · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 1 pointer-only (licence)
-
WegFormer: Transformers for Weakly Supervised Semantic Segmentation 16 Mar 2022 · 0 repositories · arXiv:2203.08421
-
2-speed network ensemble for efficient classification of incremental land-use/land-cover satellite image chips 15 Mar 2022 · 0 repositories · arXiv:2203.08267
-
ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation 15 Mar 2022 · 0 repositories · arXiv:2203.07706
-
Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation 15 Mar 2022 · 1 repository · arXiv:2203.07687
-
Data Contamination: From Memorization to Exploitation 15 Mar 2022 · 1 repository · arXiv:2203.08242Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Do BERTs Learn to Use Browser User Interface? Exploring Multi-Step Tasks with Unified Vision-and-Language BERTs 15 Mar 2022 · 1 repository · arXiv:2203.07828Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Do Language Models Plagiarize? 15 Mar 2022 · 1 repository · arXiv:2203.07618
-
Efficient Long Sequence Encoding via Synchronization 15 Mar 2022 · 0 repositories · arXiv:2203.07644
-
Fast Autofocusing using Tiny Transformer Networks for Digital Holographic Microscopy 15 Mar 2022 · 1 repository · arXiv:2203.07772
-
Generating Privacy-Preserving Process Data with Deep Generative Models 15 Mar 2022 · 0 repositories · arXiv:2203.07949
-
HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction 15 Mar 2022 · 2 repositories · arXiv:2203.08213Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 3 pointer-only (licence)
-
Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost 15 Mar 2022 · 1 repository · arXiv:2203.07860Syntology official (archive's flag): 2 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understanding 15 Mar 2022 · 1 repository · arXiv:2203.07997Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Smoothing Matters: Momentum Transformer for Domain Adaptive Semantic Segmentation 15 Mar 2022 · 1 repository · arXiv:2203.07988Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
The Ghost in the Machine has an American accent: value conflict in GPT-3 15 Mar 2022 · 0 repositories · arXiv:2203.07785
-
Unified Visual Transformer Compression 15 Mar 2022 · 1 repository · arXiv:2203.08243Syntology official (archive's flag): 7 ran · 9 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples) · 3 pointer-only (licence)
-
Accelerating DETR Convergence via Semantic-Aligned Matching 14 Mar 2022 · 1 repository · arXiv:2203.06883Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
All in One: Exploring Unified Video-Language Pre-training 14 Mar 2022 · 1 repository · arXiv:2203.07303
-
Can pre-trained Transformers be used in detecting complex sensitive sentences? -- A Monsanto case study 14 Mar 2022 · 0 repositories · arXiv:2203.06793
-
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations 14 Mar 2022 · 0 repositories · arXiv:2203.07511
-
Efficient Language Modeling with Sparse all-MLP 14 Mar 2022 · 0 repositories · arXiv:2203.06850
-
Deep Transformers Thirst for Comprehensive-Frequency Data 14 Mar 2022 · 1 repository · arXiv:2203.07116
-
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models 14 Mar 2022 · 2 repositories · arXiv:2203.07281Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Switch Trajectory Transformer with Distributional Value Approximation for Multi-Task Reinforcement Learning 14 Mar 2022 · 0 repositories · arXiv:2203.07413
-
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models 14 Mar 2022 · 1 repository · arXiv:2203.07259
-
VAST: The Valence-Assessing Semantics Test for Contextualizing Language Models 14 Mar 2022 · 1 repository · arXiv:2203.07504
-
WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition 14 Mar 2022 · 0 repositories · arXiv:2203.06925
-
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification 13 Mar 2022 · 2 repositories · arXiv:2203.06760
-
Investigating the Impact of COVID-19 on Education by Social Network Mining 13 Mar 2022 · 0 repositories · arXiv:2203.06584
-
Masked Autoencoders for Point Cloud Self-supervised Learning 13 Mar 2022 · 4 repositories · arXiv:2203.06604Syntology official (archive's flag): 4 ran · 9 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 7 pointer-only (licence)
-
SATr: Slice Attention with Transformer for Universal Lesion Detection 13 Mar 2022 · 0 repositories · arXiv:2203.07373
-
Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs 13 Mar 2022 · 8 repositories · arXiv:2203.06717Syntology official (archive's flag): 4 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
SciNLI: A Corpus for Natural Language Inference on Scientific Text 13 Mar 2022 · 1 repository · arXiv:2203.06728
-
Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learning 13 Mar 2022 · 1 repository · arXiv:2203.06541
-
BiBERT: Accurate Fully Binarized BERT 12 Mar 2022 · 1 repository · arXiv:2203.06390
-
DFTR: Depth-supervised Fusion Transformer for Salient Object Detection 12 Mar 2022 · 0 repositories · arXiv:2203.06429
-
ELLE: Efficient Lifelong Pre-training for Emerging Data 12 Mar 2022 · 1 repository · arXiv:2203.06311Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
FiNER: Financial Numeric Entity Recognition for XBRL Tagging 12 Mar 2022 · 2 repositories · arXiv:2203.06482
-
Joint CNN and Transformer Network via weakly supervised Learning for efficient crowd counting 12 Mar 2022 · 0 repositories · arXiv:2203.06388
-
MarkBERT: Marking Word Boundaries Improves Chinese BERT 12 Mar 2022 · 1 repository · arXiv:2203.06378
-
One-stage Video Instance Segmentation: From Frame-in Frame-out to Clip-in Clip-out 12 Mar 2022 · 0 repositories · arXiv:2203.06421
-
The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy 12 Mar 2022 · 1 repository · arXiv:2203.06345Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)
-
Wasserstein Adversarial Transformer for Cloud Workload Prediction 12 Mar 2022 · 1 repository · arXiv:2203.06501
-
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings 11 Mar 2022 · 1 repository · arXiv:2203.05877Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
BERTopic: Neural topic modeling with a class-based TF-IDF procedure 11 Mar 2022 · 3 repositories · arXiv:2203.05794Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
-
Block-Recurrent Transformers 11 Mar 2022 · 3 repositories · arXiv:2203.07852Syntology official: no sample here; runs from other or unrecorded repositories · 18 ran (of which 2 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 3 violated, 4 with no contract checked; 9 where Syntology's instrument failed) · 5 unverified (of 23 harvested samples) · 4 pointer-only (licence)
-
Block-Sparse Adversarial Attack to Fool Transformer-Based Text Classifiers 11 Mar 2022 · 1 repository · arXiv:2203.05948
-
Font Shape-to-Impression Translation 11 Mar 2022 · 0 repositories · arXiv:2203.05808
-
Hierarchical BERT for Medical Document Understanding 11 Mar 2022 · 0 repositories · arXiv:2204.09600
-
PathSAGE: Spatial Graph Attention Neural Networks With Random Path Sampling 11 Mar 2022 · 0 repositories · arXiv:2203.05793
-
Transformer-based Streaming ASR with Cumulative Attention 11 Mar 2022 · 0 repositories · arXiv:2203.05736
-
Using Word Embeddings to Analyze Protests News 11 Mar 2022 · 0 repositories · arXiv:2203.05875
-
verBERT: Automating Brazilian Case Law Document Multi-label Categorization Using BERT 11 Mar 2022 · 1 repository · arXiv:2203.06224
-
Visualizing and Understanding Patch Interactions in Vision Transformer 11 Mar 2022 · 0 repositories · arXiv:2203.05922
-
When classifying grammatical role, BERT doesn't care about word order... except when it matters 11 Mar 2022 · 1 repository · arXiv:2203.06204
-
A new approach to calculating BERTScore for automatic assessment of translation quality 10 Mar 2022 · 0 repositories · arXiv:2203.05598
-
Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context 10 Mar 2022 · 1 repository · arXiv:2203.05648
-
Look Backward and Forward: Self-Knowledge Distillation with Bidirectional Decoder for Neural Machine Translation 10 Mar 2022 · 0 repositories · arXiv:2203.05248
-
Parameter-Free Attentive Scoring for Speaker Verification 10 Mar 2022 · 1 repository · arXiv:2203.05642
-
Semantic Norm Recognition and its application to Portuguese Law 10 Mar 2022 · 0 repositories · arXiv:2203.05425
-
Speciesist Language and Nonhuman Animal Bias in English Masked Language Models 10 Mar 2022 · 1 repository · arXiv:2203.05140
-
StyleBabel: Artistic Style Tagging and Captioning 10 Mar 2022 · 0 repositories · arXiv:2203.05321
-
TrueType Transformer: Character and Font Style Recognition in Outline Format 10 Mar 2022 · 1 repository · arXiv:2203.05338
-
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice 9 Mar 2022 · 1 repository · arXiv:2203.05962Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
ChiTransformer:Towards Reliable Stereo from Cues 9 Mar 2022 · 1 repository · arXiv:2203.04554
-
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction 9 Mar 2022 · 1 repository · arXiv:2203.04845Syntology official (archive's flag): 13 ran · 13 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples)
-
Detecting and Diagnosing Terrestrial Gravitational-Wave Mimics Through Feature Learning 9 Mar 2022 · 0 repositories · arXiv:2203.05086
-
Multiscale Convolutional Transformer with Center Mask Pretraining for Hyperspectral Image Classification 9 Mar 2022 · 0 repositories · arXiv:2203.04771
-
NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks 9 Mar 2022 · 1 repository · arXiv:2203.05081
-
PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation 9 Mar 2022 · 2 repositories · arXiv:2203.04568
-
Region-Aware Face Swapping 9 Mar 2022 · 0 repositories · arXiv:2203.04564
-
The evolution, evolvability and engineering of gene regulatory DNA 9 Mar 2022 · 1 repository
-
Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classification 9 Mar 2022 · 0 repositories · arXiv:2203.04614
-
CaSS: A Channel-aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification 8 Mar 2022 · 0 repositories · arXiv:2203.04298
-
CF-ViT: A General Coarse-to-Fine Method for Vision Transformer 8 Mar 2022 · 1 repository · arXiv:2203.03821Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
DuMLP-Pin: A Dual-MLP-dot-product Permutation-invariant Network for Set Feature Extraction 8 Mar 2022 · 1 repository · arXiv:2203.04007
-
Dynamic Group Transformer: A General Vision Transformer Backbone with Dynamic Group Attention 8 Mar 2022 · 0 repositories · arXiv:2203.03937
-
ParC-Net: Position Aware Circular Convolution with Merits from ConvNets and Transformer 8 Mar 2022 · 3 repositories · arXiv:2203.03952Syntology official (archive's flag): 5 ran · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Graph Attention Transformer Network for Multi-Label Image Classification 8 Mar 2022 · 1 repository · arXiv:2203.04049
-
Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4 8 Mar 2022 · 1 repository · arXiv:2203.06649
-
Lane Detection with Versatile AtrousFormer and Local Semantic Guidance 8 Mar 2022 · 0 repositories · arXiv:2203.04067
-
Measuring the Mixing of Contextual Information in the Transformer 8 Mar 2022 · 2 repositories · arXiv:2203.04212Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Towards Generalized Models for Task-oriented Dialogue Modeling on Spoken Conversations 8 Mar 2022 · 0 repositories · arXiv:2203.04045
-
IT5: Text-to-text Pretraining for Italian Language Understanding and Generation 7 Mar 2022 · 3 repositories · arXiv:2203.03759
-
Monocular Robot Navigation with Self-Supervised Pretrained Vision Transformers 7 Mar 2022 · 0 repositories · arXiv:2203.03682
-
SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding 7 Mar 2022 · 0 repositories · arXiv:2203.03312
-
Pre-trained Token-replaced Detection Model as Few-shot Learner 7 Mar 2022 · 1 repository · arXiv:2203.03235
-
Stepwise Feature Fusion: Local Guides Global 7 Mar 2022 · 1 repository · arXiv:2203.03635
-
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer 7 Mar 2022 · 7 repositories · arXiv:2203.03466Syntology official (archive's flag): 1 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
WaveMix: Resource-efficient Token Mixing for Images 7 Mar 2022 · 1 repository · arXiv:2203.03689Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation 6 Mar 2022 · 1 repository · arXiv:2203.02951
-
Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents 6 Mar 2022 · 1 repository · arXiv:2203.02898
-
Exploring Dual-task Correlation for Pose Guided Person Image Generation 6 Mar 2022 · 1 repository · arXiv:2203.02910Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Graph Neural Network Enhanced Language Models for Efficient Multilingual Text Classification 6 Mar 2022 · 0 repositories · arXiv:2203.02912
-
Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos 6 Mar 2022 · 0 repositories · arXiv:2203.03014
-
Leveraging Pre-trained BERT for Audio Captioning 6 Mar 2022 · 0 repositories · arXiv:2203.02838
-
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation 6 Mar 2022 · 1 repository · arXiv:2203.02891Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
-
PanFormer: a Transformer Based Model for Pan-sharpening 6 Mar 2022 · 1 repository · arXiv:2203.02916
-
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification 4 Mar 2022 · 1 repository · arXiv:2203.02225