Methods › General › Attention Mechanisms › Attention › Papers, page 273
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 273 of 316: papers 27,201 to 27,300 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Temporal Action Proposal Generation with Transformers 25 May 2021 · 0 repositories · arXiv:2105.12043
-
Topic Modeling and Progression of American Digital News Media During the Onset of the COVID-19 Pandemic 25 May 2021 · 0 repositories · arXiv:2106.09572
-
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference 25 May 2021 · 1 repository · arXiv:2105.11618
-
Understanding Mobile GUI: from Pixel-Words to Screen-Sentences 25 May 2021 · 0 repositories · arXiv:2105.11941
-
ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documents 25 May 2021 · 0 repositories · arXiv:2105.11672
-
Classifying Math KCs via Task-Adaptive Pre-Trained BERT 24 May 2021 · 0 repositories · arXiv:2105.11343
-
DaN+: Danish Nested Named Entities and Lexical Normalization 24 May 2021 · 1 repository · arXiv:2105.11301
-
De-identification of Privacy-related Entities in Job Postings 24 May 2021 · 1 repository · arXiv:2105.11223
-
Diacritics Restoration using BERT with Analysis on Czech language 24 May 2021 · 1 repository · arXiv:2105.11408Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Fine-grained Post-training for Improving Retrieval-based Dialogue Systems 24 May 2021 · 1 repository
-
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training 24 May 2021 · 1 repository · arXiv:2105.11333Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Neural Language Models for Nineteenth-Century English 24 May 2021 · 2 repositories · arXiv:2105.11321
-
Prevent the Language Model from being Overconfident in Neural Machine Translation 24 May 2021 · 1 repository · arXiv:2105.11098
-
RobeCzech: Czech RoBERTa, a monolingual contextualized language representation model 24 May 2021 · 0 repositories · arXiv:2105.11314
-
Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models 24 May 2021 · 0 repositories · arXiv:2105.11136
-
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding 23 May 2021 · 1 repository · arXiv:2105.10912
-
End-to-End Video Object Detection with Spatial-Temporal Transformers 23 May 2021 · 1 repository · arXiv:2105.10920
-
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs 23 May 2021 · 0 repositories · arXiv:2105.10909
-
AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly 22 May 2021 · 1 repository · arXiv:2105.10762Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Denoising Noisy Neural Networks: A Bayesian Approach with Compensation 22 May 2021 · 1 repository · arXiv:2105.10699
-
Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning 21 May 2021 · 0 repositories · arXiv:2105.10195
-
Attention as Inference via Fenchel Duality 21 May 2021 · 0 repositories
-
Federated Split Task-Agnostic Vision Transformer for COVID-19 CXR Diagnosis 21 May 2021 · 0 repositories
-
Grounding inductive biases in natural images: invariance stems from variations in data 21 May 2021 · 1 repository
-
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training 21 May 2021 · 0 repositories
-
Scatterbrain: Unifying Sparse and Low-rank Attention 21 May 2021 · 1 repository
-
Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media 21 May 2021 · 0 repositories · arXiv:2105.10272
-
Towards Automatic Comparison of Data Privacy Documents: A Preliminary Experiment on GDPR-like Laws 21 May 2021 · 1 repository · arXiv:2105.10117
-
UFC-BERT: Unifying Multi-Modal Controls for Conditional Image Synthesis 21 May 2021 · 0 repositories
-
Should We Trust This Summary? Bayesian Abstractive Summarization to The Rescue 21 May 2021 · 0 repositories · arXiv:2105.10155
-
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining 21 May 2021 · 0 repositories · arXiv:2105.10419
-
A comparative evaluation and analysis of three generations of Distributional Semantic Models 20 May 2021 · 1 repository · arXiv:2105.09825
-
Content-Augmented Feature Pyramid Network with Light Linear Spatial Transformers for Object Detection 20 May 2021 · 0 repositories · arXiv:2105.09464
-
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation 20 May 2021 · 3 repositories · arXiv:2105.09501
-
Data Curation and Quality Assurance for Machine Learning-based Cyber Intrusion Detection 20 May 2021 · 1 repository · arXiv:2105.10041
-
DeepCAD: A Deep Generative Network for Computer-Aided Design Models 20 May 2021 · 1 repository · arXiv:2105.09492Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 7 harvested samples)
-
Enhancing Cross-Sectional Currency Strategies by Context-Aware Learning to Rank with Self-Attention 20 May 2021 · 1 repository · arXiv:2105.10019
-
Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking 20 May 2021 · 1 repository · arXiv:2105.09816
-
Multimodal AutoML on Structured Tables with Text Fields 20 May 2021 · 1 repository
-
See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization 20 May 2021 · 0 repositories · arXiv:2105.09601
-
VTNet: Visual Transformer Network for Object Goal Navigation 20 May 2021 · 0 repositories · arXiv:2105.09447
-
Do Models Learn the Directionality of Relations? A New Evaluation: Relation Direction Recognition 19 May 2021 · 1 repository · arXiv:2105.09045
-
Explainable Health Risk Predictor with Transformer-based Medicare Claim Encoder 19 May 2021 · 0 repositories · arXiv:2105.09428
-
Explainable Tsetlin Machine framework for fake news detection with credibility score assessment 19 May 2021 · 6 repositories · arXiv:2105.09114
-
Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies 19 May 2021 · 1 repository · arXiv:2105.08882
-
Learning Language Specific Sub-network for Multilingual Machine Translation 19 May 2021 · 1 repository · arXiv:2105.09259
-
Methods for Detoxification of Texts for the Russian Language 19 May 2021 · 3 repositories · arXiv:2105.09052
-
Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead 19 May 2021 · 0 repositories · arXiv:2105.09121
-
DRILL: Dynamic Representations for Imbalanced Lifelong Learning 18 May 2021 · 1 repository · arXiv:2105.08445Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Effective Attention Sheds Light On Interpretability 18 May 2021 · 1 repository · arXiv:2105.08855
-
Exploiting Adapters for Cross-lingual Low-resource Speech Recognition 18 May 2021 · 2 repositories · arXiv:2105.11905
-
Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing 18 May 2021 · 0 repositories · arXiv:2105.08807
-
Relative Positional Encoding for Transformers with Linear Complexity 18 May 2021 · 1 repository · arXiv:2105.08399Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing 18 May 2021 · 0 repositories
-
Vision Transformer for Fast and Efficient Scene Text Recognition 18 May 2021 · 3 repositories · arXiv:2105.08582
-
A Fine-Grained Visual Attention Approach for Fingerspelling Recognition in the Wild 17 May 2021 · 0 repositories · arXiv:2105.07625
-
Compressed Communication for Distributed Training: Adaptive Methods and System 17 May 2021 · 1 repository · arXiv:2105.07829
-
Learning to Relate Depth and Semantics for Unsupervised Domain Adaptation 17 May 2021 · 1 repository · arXiv:2105.07830Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Pay Attention to MLPs 17 May 2021 · 20 repositories · arXiv:2105.08050Syntology 34 ran (of which 15 constructed an object rather than computing a result; 31 with no instrument failure: 1 honoured, 4 violated, 26 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (of 44 harvested samples) · 11 pointer-only (licence)
-
Towards Robust Vision Transformer 17 May 2021 · 2 repositories · arXiv:2105.07926
-
Stage-wise Fine-tuning for Graph-to-Text Generation 17 May 2021 · 1 repository · arXiv:2105.08021
-
TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning 17 May 2021 · 3 repositories · arXiv:2105.07944
-
Vision Transformers are Robust Learners 17 May 2021 · 1 repository · arXiv:2105.07581Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
BdLAN:BERTdoc Label Attention Networks for Multi-label text classification 16 May 2021 · 0 repositories
-
Coming to its senses: Lessons learned from Approximating Retrofitted BERT representations for Word Sense information 16 May 2021 · 0 repositories
-
Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers 16 May 2021 · 0 repositories
-
How is BERT surprised? Layerwise detection of linguistic anomalies 16 May 2021 · 1 repository · arXiv:2105.07452
-
Neural Predictive Text for Grammatical Error Prevention 16 May 2021 · 0 repositories
-
SINA-BERT: A Pre-Trained Language Model for Analysis of Medical Texts in Persian 16 May 2021 · 0 repositories
-
SLGPT: Using Transfer Learning to Directly Generate Simulink Model Files and Find Bugs in the Simulink Toolchain 16 May 2021 · 1 repository · arXiv:2105.07465
-
Subtopic Clustering with a Query-Specific Siamese Similarity Metric 16 May 2021 · 0 repositories
-
Are Convolutional Neural Networks or Transformers more like human vision? 15 May 2021 · 1 repository · arXiv:2105.07197
-
DirectQE: Direct Pretraining for Machine Translation Quality Estimation 15 May 2021 · 0 repositories · arXiv:2105.07149
-
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter 15 May 2021 · 1 repository · arXiv:2105.07148
-
RadioNet: Transformer based Radio Map Prediction Model For Dense Urban Environments 15 May 2021 · 0 repositories · arXiv:2105.07158
-
The Low-Dimensional Linear Geometry of Contextualized Word Representations 15 May 2021 · 0 repositories · arXiv:2105.07109
-
BERT Busters: Outlier Dimensions that Disrupt Transformers 14 May 2021 · 0 repositories · arXiv:2105.06990
-
Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction 14 May 2021 · 0 repositories · arXiv:2105.06965
-
DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing 14 May 2021 · 0 repositories · arXiv:2105.06681
-
Dynamic Multi-Branch Layers for On-Device Neural Machine Translation 14 May 2021 · 1 repository · arXiv:2105.06679
-
RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling 14 May 2021 · 1 repository · arXiv:2105.06597
-
Distilling BERT for low complexity network training 13 May 2021 · 0 repositories · arXiv:2105.06514
-
Episodic Transformer for Vision-and-Language Navigation 13 May 2021 · 1 repository · arXiv:2105.06453Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples)
-
Manipulation Detection in Satellite Images Using Vision Transformer 13 May 2021 · 0 repositories · arXiv:2105.06373
-
A Large-Scale Benchmark for Food Image Segmentation 12 May 2021 · 2 repositories · arXiv:2105.05409Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
BertGCN: Transductive Text Classification by Combining GCN and BERT 12 May 2021 · 1 repository · arXiv:2105.05727
-
Better than BERT but Worse than Baseline 12 May 2021 · 0 repositories · arXiv:2105.05915
-
Building a Question and Answer System for News Domain 12 May 2021 · 0 repositories · arXiv:2105.05744
-
Ensemble Making Few-Shot Learning Stronger 12 May 2021 · 0 repositories · arXiv:2105.11904
-
Evaluating Gender Bias in Natural Language Inference 12 May 2021 · 1 repository · arXiv:2105.05541
-
Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense 12 May 2021 · 0 repositories · arXiv:2105.05913
-
Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layouts 12 May 2021 · 0 repositories · arXiv:2105.05796
-
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation 12 May 2021 · 1 repository · arXiv:2105.05912
-
News Headline Grouping as a Challenging NLU Task 12 May 2021 · 1 repository · arXiv:2105.05391
-
OCHADAI-KYOTO at SemEval-2021 Task 1: Enhancing Model Generalization and Robustness for Lexical Complexity Prediction 12 May 2021 · 0 repositories · arXiv:2105.05535
-
Playing Codenames with Language Graphs and Word Embeddings 12 May 2021 · 1 repository · arXiv:2105.05885
-
Priberam at MESINESP Multi-label Classification of Medical Texts Task 12 May 2021 · 1 repository · arXiv:2105.05614
-
Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task 12 May 2021 · 0 repositories · arXiv:2105.05605
-
Segmenter: Transformer for Semantic Segmentation 12 May 2021 · 8 repositories · arXiv:2105.05633Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation 12 May 2021 · 7 repositories · arXiv:2105.05537Syntology community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 18 harvested samples)