Methods › General › Attention Mechanisms › Attention › Papers, page 277
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 277 of 316: papers 27,601 to 27,700 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
AST: Audio Spectrogram Transformer 5 Apr 2021 · 5 repositories · arXiv:2104.01778Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
COVID-19 sentiment analysis via deep learning during the rise of novel cases 5 Apr 2021 · 0 repositories · arXiv:2104.10662
-
Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA 5 Apr 2021 · 0 repositories · arXiv:2104.02041
-
Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding 5 Apr 2021 · 0 repositories · arXiv:2104.02138
-
What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult 5 Apr 2021 · 0 repositories · arXiv:2104.01940
-
IITK@Detox at SemEval-2021 Task 5: Semi-Supervised Learning and Dice Loss for Toxic Spans Detection 4 Apr 2021 · 1 repository · arXiv:2104.01566
-
Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning 4 Apr 2021 · 1 repository · arXiv:2104.01666
-
IndT5: A Text-to-Text Transformer for 10 Indigenous Languages 4 Apr 2021 · 0 repositories · arXiv:2104.07483
-
MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers 4 Apr 2021 · 0 repositories · arXiv:2104.01567
-
ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction 4 Apr 2021 · 1 repository · arXiv:2104.01563
-
TransfoRNN: Capturing the Sequential Information in Self-Attention Representations for Language Modeling 4 Apr 2021 · 0 repositories · arXiv:2104.01572
-
Deepfake Detection Scheme Based on Vision Transformer and Distillation 3 Apr 2021 · 1 repository · arXiv:2104.01353
-
Efficient DETR: Improving End-to-End Object Detector with Dense Prior 3 Apr 2021 · 0 repositories · arXiv:2104.01318
-
Exploring the Role of BERT Token Representations to Explain Sentence Probing Results 3 Apr 2021 · 1 repository · arXiv:2104.01477
-
Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management 3 Apr 2021 · 0 repositories · arXiv:2104.01436
-
AAformer: Auto-Aligned Transformer for Person Re-Identification 2 Apr 2021 · 0 repositories · arXiv:2104.00921
-
Effect of depth order on iterative nested named entity recognition models 2 Apr 2021 · 0 repositories · arXiv:2104.01037
-
IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task 2 Apr 2021 · 1 repository · arXiv:2104.01046
-
M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers 2 Apr 2021 · 0 repositories · arXiv:2104.01122
-
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference 2 Apr 2021 · 12 repositories · arXiv:2104.01136Syntology official (archive's flag): 3 ran · 23 ran (of which 16 constructed an object rather than computing a result; 21 with no instrument failure: 3 honoured, 1 violated, 17 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified (of 30 harvested samples)
-
The Coronavirus is a Bioweapon: Analysing Coronavirus Fact-Checked Stories 2 Apr 2021 · 0 repositories · arXiv:2104.01215
-
Using GPT-2 to Create Synthetic Data to Improve the Prediction Performance of NLP Machine Learning Classification Models 2 Apr 2021 · 0 repositories · arXiv:2104.10658
-
A Dashboard for Mitigating the COVID-19 Misinfodemic 1 Apr 2021 · 0 repositories
-
A New View of Multi-modal Language Analysis: Audio and Video Features as Text ``Styles'' 1 Apr 2021 · 0 repositories
-
Are Neural Networks Extracting Linguistic Properties or Memorizing Training Data? An Observation with a Multilingual Probe for Predicting Tense 1 Apr 2021 · 1 repository
-
BART-TL: Weakly-Supervised Topic Label Generation 1 Apr 2021 · 0 repositories
-
BERT meets Cranfield: Uncovering the Properties of Full Ranking on Fully Labeled Data 1 Apr 2021 · 0 repositories
-
BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection 1 Apr 2021 · 1 repository
-
BERTective: Language Models and Contextual Information for Deception Detection 1 Apr 2021 · 0 repositories
-
BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression 1 Apr 2021 · 1 repository
-
Complex Question Answering on knowledge graphs using machine translation and multi-task learning 1 Apr 2021 · 0 repositories
-
Content-based Models of Quotation 1 Apr 2021 · 0 repositories
-
Detecting Scenes in Fiction: A new Segmentation Task 1 Apr 2021 · 0 repositories
-
Dynamic Graph Transformer for Implicit Tag Recognition 1 Apr 2021 · 0 repositories
-
ENPAR:Enhancing Entity and Entity Pair Representations for Joint Entity Relation Extraction 1 Apr 2021 · 1 repository
-
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation 1 Apr 2021 · 0 repositories
-
Evaluating language models for the retrieval and categorization of lexical collocations 1 Apr 2021 · 1 repository
-
Evaluating Neural Model Robustness for Machine Comprehension 1 Apr 2021 · 0 repositories
-
HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection 1 Apr 2021 · 1 repository · arXiv:2104.00639
-
How Fast can BERT Learn Simple Natural Language Inference? 1 Apr 2021 · 0 repositories
-
InterpreT: An Interactive Visualization Tool for Interpreting Transformers 1 Apr 2021 · 0 repositories
-
Keep Learning: Self-supervised Meta-learning for Learning from Inference 1 Apr 2021 · 0 repositories
-
Keyword Transformer: A Self-Attention Model for Keyword Spotting 1 Apr 2021 · 10 repositories · arXiv:2104.00769Syntology community repositories only · 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples)
-
LoFTR: Detector-Free Local Feature Matching with Transformers 1 Apr 2021 · 4 repositories · arXiv:2104.00680Syntology official (archive's flag): 4 ran · 14 ran (of which 6 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 3 pointer-only (licence)
-
Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models 1 Apr 2021 · 0 repositories
-
Multilingual Entity and Relation Extraction Dataset and Model 1 Apr 2021 · 1 repository
-
Next Generation Multitarget Trackers: Random Finite Set Methods vs Transformer-based Deep Learning 1 Apr 2021 · 1 repository · arXiv:2104.00734
-
Neural-Driven Search-Based Paraphrase Generation 1 Apr 2021 · 0 repositories
-
NLQuAD: A Non-Factoid Long Question Answering Data Set 1 Apr 2021 · 1 repository
-
On the (In)Effectiveness of Images for Text Classification 1 Apr 2021 · 0 repositories
-
Probing for idiomaticity in vector space models 1 Apr 2021 · 1 repository
-
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis 1 Apr 2021 · 2 repositories · arXiv:2104.00677Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
Retrieval, Re-ranking and Multi-task Learning for Knowledge-Base Question Answering 1 Apr 2021 · 0 repositories
-
Russian Paraphrasers: Paraphrase with Transformers 1 Apr 2021 · 2 repositories
-
TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking 1 Apr 2021 · 0 repositories · arXiv:2104.00194
-
Through the Looking Glass: Learning to Attribute Synthetic Text Generated by Language Models 1 Apr 2021 · 0 repositories
-
WakaVT: A Sequential Variational Transformer for Waka Generation 1 Apr 2021 · 0 repositories · arXiv:2104.00426
-
A Neighbourhood Framework for Resource-Lean Content Flagging 31 Mar 2021 · 0 repositories · arXiv:2103.17055
-
Adversarial Attacks and Defenses for Speech Recognition Systems 31 Mar 2021 · 0 repositories · arXiv:2103.17122
-
Going deeper with Image Transformers 31 Mar 2021 · 21 repositories · arXiv:2103.17239Syntology official: no sample here; runs from other or unrecorded repositories · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Learning Spatio-Temporal Transformer for Visual Tracking 31 Mar 2021 · 1 repository · arXiv:2103.17154Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition 31 Mar 2021 · 0 repositories · arXiv:2104.00120
-
An In-depth Analysis of Passage-Level Label Transfer for Contextual Document Ranking 30 Mar 2021 · 1 repository · arXiv:2103.16669
-
Automatic Graph Partitioning for Very Large-scale Deep Learning 30 Mar 2021 · 0 repositories · arXiv:2103.16063
-
Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformers 30 Mar 2021 · 1 repository · arXiv:2103.16289
-
Kaleido-BERT: Vision-Language Pre-training on Fashion Domain 30 Mar 2021 · 1 repository · arXiv:2103.16110Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Read and Attend: Temporal Localisation in Sign Language Videos 30 Mar 2021 · 0 repositories · arXiv:2103.16481
-
Rethinking Spatial Dimensions of Vision Transformers 30 Mar 2021 · 12 repositories · arXiv:2103.16302Syntology official: harvested, nothing ran · 10 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 20 harvested samples)
-
Spatiotemporal Transformer for Video-based Person Re-identification 30 Mar 2021 · 0 repositories · arXiv:2103.16469
-
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding 29 Mar 2021 · 3 repositories · arXiv:2103.15358Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 2 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
Transformer Tracking 29 Mar 2021 · 1 repository · arXiv:2103.15436Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
Contextual Text Embeddings for Twi 29 Mar 2021 · 0 repositories · arXiv:2103.15963
-
CvT: Introducing Convolutions to Vision Transformers 29 Mar 2021 · 16 repositories · arXiv:2103.15808Syntology official (archive's flag): 10 ran · 39 ran (of which 19 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 47 harvested samples) · 8 pointer-only (licence)
-
Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies 29 Mar 2021 · 0 repositories · arXiv:2103.15737
-
SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data 29 Mar 2021 · 2 repositories · arXiv:2103.15619Syntology official (archive's flag): 17 ran · 17 ran (of which 7 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 10 unverified (of 27 harvested samples)
-
Whitening Sentence Representations for Better Semantics and Faster Retrieval 29 Mar 2021 · 3 repositories · arXiv:2103.15316Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)
-
HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrieval 28 Mar 2021 · 0 repositories · arXiv:2103.15049
-
PENELOPIE: Enabling Open Information Extraction for the Greek Language through Machine Translation 28 Mar 2021 · 1 repository · arXiv:2103.15075
-
PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS 28 Mar 2021 · 0 repositories · arXiv:2103.15060
-
Face Transformer for Recognition 27 Mar 2021 · 2 repositories · arXiv:2103.14803Syntology official (archive's flag): 4 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification 27 Mar 2021 · 15 repositories · arXiv:2103.14899Syntology official (archive's flag): 4 ran · 17 ran (of which 10 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 1 violated, 16 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 26 harvested samples)
-
Machine Learning Meets Natural Language Processing -- The story so far 27 Mar 2021 · 0 repositories · arXiv:2104.10213
-
Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data 27 Mar 2021 · 0 repositories · arXiv:2103.14797
-
A Practical Survey on Faster and Lighter Transformers 26 Mar 2021 · 0 repositories · arXiv:2103.14636
-
Automated radiology report generation using conditioned transformers 26 Mar 2021 · 1 repository
-
BART based semantic correction for Mandarin automatic speech recognition system 26 Mar 2021 · 0 repositories · arXiv:2104.05507
-
Gated Transformer Networks for Multivariate Time Series Classification 26 Mar 2021 · 2 repositories · arXiv:2103.14438
-
Leveraging pre-trained representations to improve access to untranscribed speech from endangered languages 26 Mar 2021 · 1 repository · arXiv:2103.14583
-
Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimation 26 Mar 2021 · 1 repository · arXiv:2103.14304Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
Understanding Robustness of Transformers for Image Classification 26 Mar 2021 · 0 repositories · arXiv:2103.14586
-
Abstracting the Sampling Behaviour of Stochastic Linear Periodic Event-Triggered Control Systems 25 Mar 2021 · 0 repositories · arXiv:2103.13839
-
AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting 25 Mar 2021 · 2 repositories · arXiv:2103.14023Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 1 pointer-only (licence)
-
BERT4SO: Neural Sentence Ordering by Fine-tuning BERT 25 Mar 2021 · 0 repositories · arXiv:2103.13584
-
Bertinho: Galician BERT Representations 25 Mar 2021 · 0 repositories · arXiv:2103.13799
-
K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining 25 Mar 2021 · 0 repositories · arXiv:2104.10649
-
Mask Attention Networks: Rethinking and Strengthen Transformer 25 Mar 2021 · 1 repository · arXiv:2103.13597Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Predicting Directionality in Causal Relations in Text 25 Mar 2021 · 2 repositories · arXiv:2103.13606
-
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows 25 Mar 2021 · 80 repositories · arXiv:2103.14030Syntology official: harvested, nothing ran · 123 ran (of which 45 constructed an object rather than computing a result; 82 with no instrument failure: 5 honoured, 2 violated, 75 with no contract checked; 41 where Syntology's instrument failed) · 84 unverified (of 207 harvested samples) · 45 pointer-only (licence)
-
Visual Grounding Strategies for Text-Only Natural Language Processing 25 Mar 2021 · 0 repositories · arXiv:2103.13942
-
AutoMix: Unveiling the Power of Mixup for Stronger Classifiers 24 Mar 2021 · 3 repositories · arXiv:2103.13027Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 3 pointer-only (licence)