Methods › General › Attention Mechanisms › Attention › Papers, page 267
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 267 of 316: papers 26,601 to 26,700 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Synchronous Syntactic Attention for Transformer Neural Machine Translation 1 Aug 2021 · 0 repositories
-
Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation 1 Aug 2021 · 1 repository
-
Team_KGP at SemEval-2021 Task 7: A Deep Neural System to Detect Humor and Offense with Their Ratings in the Text Data 1 Aug 2021 · 0 repositories
-
TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models 1 Aug 2021 · 0 repositories
-
To POS Tag or Not to POS Tag: The Impact of POS Tags on Morphological Learning in Low-Resource Settings 1 Aug 2021 · 0 repositories
-
Transformer-based deep imitation learning for dual-arm robot manipulation 1 Aug 2021 · 0 repositories · arXiv:2108.00385
-
Transformer-based Map Matching Model with Limited Ground-Truth Data using Transfer-Learning Approach 1 Aug 2021 · 0 repositories · arXiv:2108.00439
-
Transformer-Encoder-GRU (T-E-GRU) for Chinese Sentiment Analysis on Chinese Comment Text 1 Aug 2021 · 0 repositories · arXiv:2108.00400
-
Unleash GPT-2 Power for Event Detection 1 Aug 2021 · 0 repositories
-
Unsupervised Extractive Summarization-Based Representations for Accurate and Explainable Collaborative Filtering 1 Aug 2021 · 1 repository
-
UoR at SemEval-2021 Task 4: Using Pre-trained BERT Token Embeddings for Question Answering of Abstract Meaning 1 Aug 2021 · 0 repositories
-
UoR at SemEval-2021 Task 7: Utilizing Pre-trained DistilBERT Model and Multi-scale CNN for Humor Detection 1 Aug 2021 · 0 repositories
-
UTFPR at SemEval-2021 Task 1: Complexity Prediction by Combining BERT Vectors and Classic Features 1 Aug 2021 · 0 repositories
-
Verb Metaphor Detection via Contextual Relation Learning 1 Aug 2021 · 0 repositories
-
YNU-HPCC at SemEval-2021 Task 11: Using a BERT Model to Extract Contributions from NLP Scholarly Articles 1 Aug 2021 · 0 repositories
-
YNU-HPCC at SemEval-2021 Task 5: Using a Transformer-based Model with Auxiliary Information for Toxic Span Detection 1 Aug 2021 · 1 repository
-
YNU-HPCC at SemEval-2021 Task 6: Combining ALBERT and Text-CNN for Persuasion Detection in Texts and Images 1 Aug 2021 · 0 repositories
-
YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective 1 Aug 2021 · 1 repository
-
ZYJ at SemEval-2021 Task 7: HaHackathon: Detecting and Rating Humor and Offense with ALBERT-Based Model 1 Aug 2021 · 0 repositories
-
Debiasing Samples from Online Learning Using Bootstrap 31 Jul 2021 · 0 repositories · arXiv:2108.00236
-
Opinion Prediction with User Fingerprinting 31 Jul 2021 · 1 repository · arXiv:2108.00270
-
Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition 31 Jul 2021 · 1 repository · arXiv:2108.00194
-
DadaGP: A Dataset of Tokenized GuitarPro Songs for Sequence Models 30 Jul 2021 · 1 repository · arXiv:2107.14653
-
DPT: Deformable Patch-based Transformer for Visual Recognition 30 Jul 2021 · 1 repository · arXiv:2107.14467Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
EmailSum: Abstractive Email Thread Summarization 30 Jul 2021 · 1 repository · arXiv:2107.14691
-
Connecting Compression Spaces with Transformer for Approximate Nearest Neighbor Search 30 Jul 2021 · 0 repositories · arXiv:2107.14415
-
Multi-Head Self-Attention via Vision Transformer for Zero-Shot Learning 30 Jul 2021 · 2 repositories · arXiv:2108.00045
-
Perceiver IO: A General Architecture for Structured Inputs & Outputs 30 Jul 2021 · 9 repositories · arXiv:2107.14795Syntology community repositories only · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretraining 30 Jul 2021 · 1 repository · arXiv:2107.14572
-
Real-time Streaming Perception System for Autonomous Driving 30 Jul 2021 · 0 repositories · arXiv:2107.14388
-
Structural Guidance for Transformer Language Models 30 Jul 2021 · 1 repository · arXiv:2108.00104Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
Adapting GPT, GPT-2 and BERT Language Models for Speech Recognition 29 Jul 2021 · 0 repositories · arXiv:2108.07789
-
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models 29 Jul 2021 · 1 repository · arXiv:2107.13686
-
Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection 29 Jul 2021 · 0 repositories · arXiv:2107.13720
-
PPT Fusion: Pyramid Patch Transformerfor a Case Study in Image Fusion 29 Jul 2021 · 0 repositories · arXiv:2107.13967
-
ReFormer: The Relational Transformer for Image Captioning 29 Jul 2021 · 1 repository · arXiv:2107.14178
-
Rethinking and Improving Relative Position Encoding for Vision Transformer 29 Jul 2021 · 1 repository · arXiv:2107.14222Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
Self-Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time-Series 29 Jul 2021 · 1 repository · arXiv:2107.14293Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Using Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation 29 Jul 2021 · 0 repositories · arXiv:2107.13689
-
Arabic aspect sentiment polarity classification using BERT 28 Jul 2021 · 0 repositories · arXiv:2107.13290
-
Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis 28 Jul 2021 · 2 repositories · arXiv:2107.13669Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Goal-Oriented Script Construction 28 Jul 2021 · 1 repository · arXiv:2107.13189
-
gaBERT -- an Irish Language Model 27 Jul 2021 · 1 repository · arXiv:2107.12930
-
Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation 27 Jul 2021 · 0 repositories · arXiv:2107.13077
-
PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution 27 Jul 2021 · 0 repositories · arXiv:2107.12600
-
ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding 26 Jul 2021 · 4 repositories · arXiv:2107.12025
-
Contextual Transformer Networks for Visual Recognition 26 Jul 2021 · 7 repositories · arXiv:2107.12292
-
Spatial-Temporal Transformer for Dynamic Scene Graph Generation 26 Jul 2021 · 2 repositories · arXiv:2107.12309Syntology official (archive's flag): 8 ran · 13 ran (of which 4 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 6 pointer-only (licence)
-
Go Wider Instead of Deeper 25 Jul 2021 · 1 repository · arXiv:2107.11817
-
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences 25 Jul 2021 · 2 repositories · arXiv:2107.11906Syntology 9 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition 24 Jul 2021 · 0 repositories · arXiv:2107.11610
-
MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimation 24 Jul 2021 · 0 repositories · arXiv:2107.14600
-
Improving Early Sepsis Prediction with Multi Modal Learning 23 Jul 2021 · 0 repositories · arXiv:2107.11094
-
Confidence-Aware Scheduled Sampling for Neural Machine Translation 22 Jul 2021 · 1 repository · arXiv:2107.10427
-
EAN: Event Adaptive Network for Enhanced Action Recognition 22 Jul 2021 · 1 repository · arXiv:2107.10771
-
Evaluating Extractive Summarization Techniques on News Articles 22 Jul 2021 · 1 repository
-
Evaluating Extractive Summarization Techniques on News Articles 22 Jul 2021 · 1 repository
-
Evaluation of contextual embeddings on less-resourced languages 22 Jul 2021 · 0 repositories · arXiv:2107.10614
-
FNetAR: Mixing Tokens with Autoregressive Fourier Transforms 22 Jul 2021 · 1 repository · arXiv:2107.10932
-
Query2Label: A Simple Transformer Way to Multi-Label Classification 22 Jul 2021 · 3 repositories · arXiv:2107.10834Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Semantic Text-to-Face GAN -ST^2FG 22 Jul 2021 · 0 repositories · arXiv:2107.10756
-
Spinning Sequence-to-Sequence Models with Meta-Backdoors 22 Jul 2021 · 0 repositories · arXiv:2107.10443
-
Tsformer: Time series Transformer for tourism demand forecasting 22 Jul 2021 · 0 repositories · arXiv:2107.10977
-
Audio Captioning Transformer 21 Jul 2021 · 1 repository · arXiv:2107.09817
-
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision 21 Jul 2021 · 0 repositories · arXiv:2107.09852
-
CycleMLP: A MLP-like Architecture for Dense Prediction 21 Jul 2021 · 8 repositories · arXiv:2107.10224Syntology official (archive's flag): 2 ran · 10 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 2 pointer-only (licence)
-
Digital Einstein Experience: Fast Text-to-Speech for Conversational AI 21 Jul 2021 · 0 repositories · arXiv:2107.10658
-
DRDF: Determining the Importance of Different Multimodal Information with Dual-Router Dynamic Framework 21 Jul 2021 · 0 repositories · arXiv:2107.09909
-
Improved Text Classification via Contrastive Adversarial Training 21 Jul 2021 · 0 repositories · arXiv:2107.10137
-
Multi-Stream Transformers 21 Jul 2021 · 1 repository · arXiv:2107.10342
-
A Multi-scale Graph Network with Multi-head Attention for Histopathology Image Diagnosis 20 Jul 2021 · 0 repositories
-
CREW: Computation Reuse and Efficient Weight Storage for Hardware-accelerated MLPs and RNNs 20 Jul 2021 · 0 repositories · arXiv:2107.09408
-
Generative Video Transformer: Can Objects be the Words? 20 Jul 2021 · 0 repositories · arXiv:2107.09240
-
Linked Data Triples Enhance Document Relevance Classification 20 Jul 2021 · 1 repository
-
Weakly Supervised Global-Local Feature Learning for Cervical Cytology Image Analysis 20 Jul 2021 · 0 repositories
-
Clinical Relation Extraction Using Transformer-based Models 19 Jul 2021 · 1 repository · arXiv:2107.08957
-
Image Fusion Transformer 19 Jul 2021 · 1 repository · arXiv:2107.09011
-
Learning Attributed Graph Representations with Communicative Message Passing Transformer 19 Jul 2021 · 1 repository · arXiv:2107.08773
-
LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation 19 Jul 2021 · 2 repositories · arXiv:2107.08623Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Long-term series forecasting with Query Selector -- efficient model of sparse attention 19 Jul 2021 · 2 repositories · arXiv:2107.08687
-
Residual Tree Aggregation of Layers for Neural Machine Translation 19 Jul 2021 · 0 repositories · arXiv:2107.14590
-
Sequence-to-Sequence Piano Transcription with Transformers 19 Jul 2021 · 2 repositories · arXiv:2107.09142Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
A Discriminative Semantic Ranker for Question Retrieval 18 Jul 2021 · 0 repositories · arXiv:2107.08345
-
Aspect-based Sentiment Analysis using BERT with Disentangled Attention 18 Jul 2021 · 1 repository
-
Stock price prediction using BERT and GAN 18 Jul 2021 · 0 repositories · arXiv:2107.09055
-
TFix: Learning to Fix Coding Errors with a Text-to-Text Transformer 18 Jul 2021 · 1 repository
-
A Vector-Based Approach to Few-Shot Veracity Classification for Automated Fact-Checking 17 Jul 2021 · 0 repositories
-
Dynamic Transformer for Efficient Machine Translation on Embedded Devices 17 Jul 2021 · 0 repositories · arXiv:2107.08199
-
Neural Search: Learning Query and Product Representations in Fashion E-commerce 17 Jul 2021 · 0 repositories · arXiv:2107.08291
-
RAMS-Trans: Recurrent Attention Multi-scale Transformer forFine-grained Image Recognition 17 Jul 2021 · 0 repositories · arXiv:2107.08192
-
A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): from Convolutional Neural Networks to Visual Transformers 16 Jul 2021 · 0 repositories · arXiv:2107.07699
-
Is attention to bounding boxes all you need for pedestrian action prediction? 16 Jul 2021 · 0 repositories · arXiv:2107.08031
-
The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues 16 Jul 2021 · 0 repositories · arXiv:2107.08128
-
AutoBERT-Zero: Evolving BERT Backbone from Scratch 15 Jul 2021 · 0 repositories · arXiv:2107.07445
-
Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension 15 Jul 2021 · 1 repository · arXiv:2107.07957
-
FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark 15 Jul 2021 · 1 repository · arXiv:2107.07498
-
Learning Sparse Interaction Graphs of Partially Detected Pedestrians for Trajectory Prediction 15 Jul 2021 · 1 repository · arXiv:2107.07056
-
Only Train Once: A One-Shot Neural Network Training And Pruning Framework 15 Jul 2021 · 1 repository · arXiv:2107.07467
-
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks 15 Jul 2021 · 1 repository · arXiv:2107.07610
-
STAR: Sparse Transformer-based Action Recognition 15 Jul 2021 · 1 repository · arXiv:2107.07089