Methods › General › Attention Mechanisms › Attention › Papers, page 282
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 282 of 316: papers 28,101 to 28,200 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Cluster & Tune: Enhance BERT Performance in Low Resource Text Classification 1 Jan 2021 · 0 repositories
-
CrackFormer: Transformer Network for Fine-Grained Crack Detection 1 Jan 2021 · 1 repository
-
Cross-Probe BERT for Efficient and Effective Cross-Modal Search 1 Jan 2021 · 0 repositories
-
DACT-BERT: Increasing the efficiency and interpretability of BERT by using adaptive computation time. 1 Jan 2021 · 0 repositories
-
Data-aware Low-Rank Compression for Large NLP Models 1 Jan 2021 · 0 repositories
-
Deep Learning Proteins using a Triplet-BERT network 1 Jan 2021 · 0 repositories
-
Deep Representational Re-tuning using Contrastive Tension 1 Jan 2021 · 1 repository
-
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection 1 Jan 2021 · 0 repositories
-
Do Transformers Understand Polynomial Simplification? 1 Jan 2021 · 0 repositories
-
Domain-slot Relationship Modeling using a Pre-trained Language Encoder for Multi-Domain Dialogue State Tracking 1 Jan 2021 · 0 repositories
-
Dynamic DETR: End-to-End Object Detection With Dynamic Attention 1 Jan 2021 · 0 repositories
-
Erasure for Advancing: Dynamic Self-Supervised Learning for Commonsense Reasoning 1 Jan 2021 · 0 repositories
-
Event-Based Video Reconstruction Using Transformer 1 Jan 2021 · 1 repository
-
Exploring Routing Strategies for Multilingual Mixture-of-Experts Models 1 Jan 2021 · 0 repositories
-
EXPLORING VULNERABILITIES OF BERT-BASED APIS 1 Jan 2021 · 0 repositories
-
Frequency-Aware Spatiotemporal Transformers for Video Inpainting Detection 1 Jan 2021 · 0 repositories
-
Generalizing Tree Models for Improving Prediction Accuracy 1 Jan 2021 · 0 repositories
-
High-Performance Discriminative Tracking With Transformers 1 Jan 2021 · 0 repositories
-
How Multipurpose Are Language Models? 1 Jan 2021 · 0 repositories
-
HyperGrid Transformers: Towards A Single Model for Multiple Tasks 1 Jan 2021 · 0 repositories
-
Image Harmonization With Transformer 1 Jan 2021 · 1 repository
-
Improving Abstractive Dialogue Summarization with Conversational Structure and Factual Knowledge 1 Jan 2021 · 0 repositories
-
Improving Generalizability of Protein Sequence Models via Data Augmentations 1 Jan 2021 · 0 repositories
-
Improving Machine Translation by Searching Skip Connections Efficiently 1 Jan 2021 · 0 repositories
-
Interpretable Multivariate Time Series Forecasting with Temporal Attention Convolutional Neural Networks 1 Jan 2021 · 1 repository
-
Isotropy in the Contextual Embedding Space: Clusters and Manifolds 1 Jan 2021 · 0 repositories
-
KETG: A Knowledge Enhanced Text Generation Framework 1 Jan 2021 · 0 repositories
-
Long Range Arena : A Benchmark for Efficient Transformers 1 Jan 2021 · 0 repositories
-
Memory Representation in Transformer 1 Jan 2021 · 0 repositories
-
Modelling Drug-Target Binding Affinity using a BERT based Graph Neural network 1 Jan 2021 · 0 repositories
-
MULTI-SPAN QUESTION ANSWERING USING SPAN-IMAGE NETWORK 1 Jan 2021 · 0 repositories
-
Multi-View 3D Reconstruction With Transformers 1 Jan 2021 · 0 repositories
-
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images 1 Jan 2021 · 1 repository
-
Non-iterative Parallel Text Generation via Glancing Transformer 1 Jan 2021 · 0 repositories
-
On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification 1 Jan 2021 · 2 repositories · arXiv:2101.00196
-
On Position Embeddings in BERT 1 Jan 2021 · 0 repositories
-
Parameterization of Hypercomplex Multiplications 1 Jan 2021 · 0 repositories
-
PhraseTransformer: Self-Attention using Local Context for Semantic Parsing 1 Jan 2021 · 1 repository
-
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models 1 Jan 2021 · 1 repository · arXiv:2101.00288
-
Post-Training Weighted Quantization of Neural Networks for Language Models 1 Jan 2021 · 0 repositories
-
Pre-training Text-to-Text Transformers to Write and Reason with Concepts 1 Jan 2021 · 0 repositories
-
Predictive Attention Transformer: Improving Transformer with Attention Map Prediction 1 Jan 2021 · 0 repositories
-
Prefix-Tuning: Optimizing Continuous Prompts for Generation 1 Jan 2021 · 13 repositories · arXiv:2101.00190Syntology community repositories only · 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Pretrain Knowledge-Aware Language Models 1 Jan 2021 · 0 repositories
-
Representation and Bias in Multilingual NLP: Insights from Controlled Experiments on Conditional Language Modeling 1 Jan 2021 · 0 repositories
-
Representational correlates of hierarchical phrase structure in deep language models 1 Jan 2021 · 0 repositories
-
Scene Context-Aware Salient Object Detection 1 Jan 2021 · 1 repository
-
Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation 1 Jan 2021 · 0 repositories
-
Single Layers of Attention Suffice to Predict Protein Contacts 1 Jan 2021 · 0 repositories
-
SkillBERT: “Skilling” the BERT to classify skills! 1 Jan 2021 · 0 repositories
-
Speeding up Deep Learning Training by Sharing Weights and Then Unsharing 1 Jan 2021 · 0 repositories
-
STAR: A Structure-Aware Lightweight Transformer for Real-Time Image Enhancement 1 Jan 2021 · 1 repository
-
Subformer: A Parameter Reduced Transformer 1 Jan 2021 · 0 repositories
-
Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers 1 Jan 2021 · 1 repository · arXiv:2101.00234
-
Syntactic Relevance XLNet Word Embedding Generation in Low-Resource Machine Translation 1 Jan 2021 · 0 repositories
-
Synthesizer: Rethinking Self-Attention for Transformer Models 1 Jan 2021 · 0 repositories
-
Taking Notes on the Fly Helps Language Pre-Training 1 Jan 2021 · 0 repositories
-
Task-Agnostic and Adaptive-Size BERT Compression 1 Jan 2021 · 0 repositories
-
Towards Practical Second Order Optimization for Deep Learning 1 Jan 2021 · 0 repositories
-
Trans-Caps: Transformer Capsule Networks with Self-attention Routing 1 Jan 2021 · 0 repositories
-
Transformer based Automatic COVID-19 Fake News Detection System 1 Jan 2021 · 2 repositories · arXiv:2101.00180
-
Transformer protein language models are unsupervised structure learners 1 Jan 2021 · 0 repositories
-
Transformer-QL: A Step Towards Making Transformer Network Quadratically Large 1 Jan 2021 · 0 repositories
-
Transformers satisfy 1 Jan 2021 · 0 repositories
-
Transforming Recurrent Neural Networks with Attention and Fixed-point Equations 1 Jan 2021 · 0 repositories
-
TRAR: Routing the Attention Spans in Transformer for Visual Question Answering 1 Jan 2021 · 1 repository
-
U-BERT: Pre-training User Representations for Improved Recommendation 1 Jan 2021 · 0 repositories
-
UPDeT: Universal Multi-agent RL via Policy Decoupling with Transformers 1 Jan 2021 · 0 repositories
-
UserBERT: Self-supervised User Representation Learning 1 Jan 2021 · 0 repositories
-
Visual Transformers: Where Do Transformers Really Belong in Vision Models? 1 Jan 2021 · 0 repositories
-
VisualSparta: An Embarrassingly Simple Approach to Large-scale Text-to-Image Search with Weighted Bag-of-words 1 Jan 2021 · 1 repository · arXiv:2101.00265
-
WARP: Word-level Adversarial ReProgramming 1 Jan 2021 · 1 repository · arXiv:2101.00121
-
WB-DETR: Transformer-Based Detector Without Backbone 1 Jan 2021 · 0 repositories
-
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters 31 Dec 2020 · 0 repositories · arXiv:2012.15682
-
A Multi-modal Deep Learning Model for Video Thumbnail Selection 31 Dec 2020 · 0 repositories · arXiv:2101.00073
-
Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning 31 Dec 2020 · 1 repository · arXiv:2012.15699
-
BinaryBERT: Pushing the Limit of BERT Quantization 31 Dec 2020 · 1 repository · arXiv:2012.15701Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations 31 Dec 2020 · 1 repository · arXiv:2012.15643
-
Conditional Generation of Temporally-ordered Event Sequences 31 Dec 2020 · 0 repositories · arXiv:2012.15786
-
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation 31 Dec 2020 · 1 repository · arXiv:2012.15416Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets 31 Dec 2020 · 1 repository · arXiv:2101.00063Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Evidence-based Factual Error Correction 31 Dec 2020 · 3 repositories · arXiv:2012.15788
-
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade 31 Dec 2020 · 1 repository · arXiv:2012.15833
-
KART: Parameterization of Privacy Leakage Scenarios from Pre-trained Language Models 31 Dec 2020 · 1 repository · arXiv:2101.00036
-
Fast WordPiece Tokenization 31 Dec 2020 · 1 repository · arXiv:2012.15524
-
Making Pre-trained Language Models Better Few-shot Learners 31 Dec 2020 · 9 repositories · arXiv:2012.15723Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 9 harvested samples) · 7 pointer-only (licence)
-
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers 31 Dec 2020 · 2 repositories · arXiv:2012.15828
-
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers 31 Dec 2020 · 5 repositories · arXiv:2012.15840
-
Revisiting Robust Neural Machine Translation: A Transformer Case Study 31 Dec 2020 · 0 repositories · arXiv:2012.15710
-
Studying Strategically: Learning to Mask for Closed-book QA 31 Dec 2020 · 0 repositories · arXiv:2012.15856
-
The Pile: An 800GB Dataset of Diverse Text for Language Modeling 31 Dec 2020 · 22 repositories · arXiv:2101.00027Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
TransTrack: Multiple Object Tracking with Transformer 31 Dec 2020 · 2 repositories · arXiv:2012.15460
-
Unified Mandarin TTS Front-end Based on Distilled BERT Model 31 Dec 2020 · 1 repository · arXiv:2012.15404
-
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts 31 Dec 2020 · 2 repositories · arXiv:2012.15562
-
Verb Knowledge Injection for Multilingual Event Processing 31 Dec 2020 · 0 repositories · arXiv:2012.15421
-
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders 31 Dec 2020 · 0 repositories · arXiv:2012.15547
-
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning 30 Dec 2020 · 2 repositories · arXiv:2012.15283
-
Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings 30 Dec 2020 · 0 repositories · arXiv:2012.15353
-
Improving BERT with Syntax-aware Local Attention 30 Dec 2020 · 1 repository · arXiv:2012.15150
-
Optimizing Deeper Transformers on Small Datasets 30 Dec 2020 · 1 repository · arXiv:2012.15355