Methods › General › Attention Mechanisms › Attention › Papers, page 265
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 265 of 316: papers 26,401 to 26,500 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistance 20 Aug 2021 · 1 repository · arXiv:2108.09174
-
Uncertainties and output feedback in rollout event-triggered control 20 Aug 2021 · 0 repositories · arXiv:2108.09125
-
A Framework for Neural Topic Modeling of Text Corpora 19 Aug 2021 · 1 repository · arXiv:2108.08946
-
Causal Attention for Unbiased Visual Recognition 19 Aug 2021 · 1 repository · arXiv:2108.08782Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Contrastive Language-Image Pre-training for the Italian Language 19 Aug 2021 · 1 repository · arXiv:2108.08688
-
Detection of Illicit Drug Trafficking Events on Instagram: A Deep Multimodal Multilabel Learning Approach 19 Aug 2021 · 0 repositories · arXiv:2108.08920
-
Do Vision Transformers See Like Convolutional Neural Networks? 19 Aug 2021 · 4 repositories · arXiv:2108.08810Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Fast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage Expansion 19 Aug 2021 · 1 repository · arXiv:2108.08513
-
Fine-Grained Element Identification in Complaint Text of Internet Fraud 19 Aug 2021 · 0 repositories · arXiv:2108.08676
-
How Hateful are Movies? A Study and Prediction on Movie Subtitles 19 Aug 2021 · 1 repository · arXiv:2108.10724
-
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation 19 Aug 2021 · 0 repositories · arXiv:2108.08447
-
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models 19 Aug 2021 · 2 repositories · arXiv:2108.08877
-
UNIQORN: Unified Question Answering over RDF Knowledge Graphs and Natural Language Text 19 Aug 2021 · 1 repository · arXiv:2108.08614
-
Video Relation Detection via Tracklet based Visual Transformer 19 Aug 2021 · 1 repository · arXiv:2108.08669
-
Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks 18 Aug 2021 · 0 repositories · arXiv:2108.08375
-
Integrating Dialog History into End-to-End Spoken Language Understanding Systems 18 Aug 2021 · 0 repositories · arXiv:2108.08405
-
SHAQ: Single Headed Attention with Quasi-Recurrence 18 Aug 2021 · 0 repositories · arXiv:2108.08207
-
SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item Recommendation 18 Aug 2021 · 0 repositories · arXiv:2108.08022
-
Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models 18 Aug 2021 · 1 repository · arXiv:2108.08111
-
Transformers predicting the future. Applying attention in next-frame and time series forecasting 18 Aug 2021 · 1 repository · arXiv:2108.08224
-
TSI: an Ad Text Strength Indicator using Text-to-CTR and Semantic-Ad-Similarity 18 Aug 2021 · 0 repositories · arXiv:2108.08226
-
A Multi-level Acoustic Feature Extraction Framework for Transformer Based End-to-End Speech Recognition 18 Aug 2021 · 0 repositories · arXiv:2108.07980
-
Boosting Salient Object Detection with Transformer-based Asymmetric Bilateral U-Net 17 Aug 2021 · 1 repository · arXiv:2108.07851
-
EncT5: Fine-tuning T5 Encoder for Discriminative Tasks 17 Aug 2021 · 0 repositories
-
Learning C to x86 Translation: An Experiment in Neural Compilation 17 Aug 2021 · 1 repository · arXiv:2108.07639Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Light Field Image Super-Resolution with Transformers 17 Aug 2021 · 1 repository · arXiv:2108.07597
-
MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation 17 Aug 2021 · 0 repositories · arXiv:2108.07505
-
Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues 17 Aug 2021 · 1 repository
-
Semantics-aware Attention Improves Neural Machine Translation 17 Aug 2021 · 0 repositories
-
Accounting for shared covariates in semi-parametric Bayesian additive regression trees 17 Aug 2021 · 2 repositories · arXiv:2108.07636
-
An Effective Non-Autoregressive Model for Spoken Language Understanding 16 Aug 2021 · 0 repositories · arXiv:2108.07005
-
Deep Natural Language Processing for LinkedIn Search 16 Aug 2021 · 0 repositories · arXiv:2108.13300
-
Misleading the Covid-19 vaccination discourse on Twitter: An exploratory study of infodemic around the pandemic 16 Aug 2021 · 1 repository · arXiv:2108.10735
-
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency 16 Aug 2021 · 1 repository · arXiv:2108.06858
-
On the Opportunities and Risks of Foundation Models 16 Aug 2021 · 2 repositories · arXiv:2108.07258
-
Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch 16 Aug 2021 · 1 repository · arXiv:2108.07353
-
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning 15 Aug 2021 · 0 repositories · arXiv:2108.06743
-
Exploring Temporal Coherence for More General Video Face Forgery Detection 15 Aug 2021 · 1 repository · arXiv:2108.06693Syntology 6 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Maps Search Misspelling Detection Leveraging Domain-Augmented Contextual Representations 15 Aug 2021 · 0 repositories · arXiv:2108.06842
-
SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation 15 Aug 2021 · 0 repositories · arXiv:2108.06643
-
SOTR: Segmenting Objects with Transformers 15 Aug 2021 · 1 repository · arXiv:2108.06747Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
heterogeneous temporal graph transformer: an intelligent system for evolving android malware detection 14 Aug 2021 · 1 repository
-
Conditional DETR for Fast Training Convergence 13 Aug 2021 · 4 repositories · arXiv:2108.06152Syntology official (archive's flag): 5 ran · 6 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models 13 Aug 2021 · 1 repository · arXiv:2108.06084
-
PVT: Point-Voxel Transformer for Point Cloud Learning 13 Aug 2021 · 2 repositories · arXiv:2108.06076
-
Towards Structured Dynamic Sparse Pre-Training of BERT 13 Aug 2021 · 0 repositories · arXiv:2108.06277
-
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing 12 Aug 2021 · 1 repository · arXiv:2108.05542
-
How Optimal is Greedy Decoding for Extractive Question Answering? 12 Aug 2021 · 1 repository · arXiv:2108.05857Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Mobile-Former: Bridging MobileNet and Transformer 12 Aug 2021 · 4 repositories · arXiv:2108.05895
-
Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigm 12 Aug 2021 · 0 repositories · arXiv:2108.05652
-
Multimodal analysis of the predictability of hand-gesture properties 12 Aug 2021 · 0 repositories · arXiv:2108.05762
-
MUSIQ: Multi-scale Image Quality Transformer 12 Aug 2021 · 2 repositories · arXiv:2108.05997Syntology community repositories only · 5 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languages 12 Aug 2021 · 0 repositories · arXiv:2108.05927
-
PatrickStar: Parallel Training of Pre-trained Models via Chunk-based Memory Management 12 Aug 2021 · 1 repository · arXiv:2108.05818
-
TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation 12 Aug 2021 · 1 repository · arXiv:2108.05988Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization 11 Aug 2021 · 0 repositories · arXiv:2108.05123
-
ConvNets vs. Transformers: Whose Visual Representations are More Transferable? 11 Aug 2021 · 0 repositories · arXiv:2108.05305
-
Medical-VLBERT: Medical Visual Language BERT for COVID-19 CT Report Generation With Alternate Learning 11 Aug 2021 · 0 repositories · arXiv:2108.05067
-
NoFake at CheckThat! 2021: Fake News Detection Using BERT 11 Aug 2021 · 0 repositories · arXiv:2108.05419
-
Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing 11 Aug 2021 · 1 repository · arXiv:2108.04990
-
Variable-Length Music Score Infilling via XLNet and Musically Specialized Positional Encoding 11 Aug 2021 · 1 repository · arXiv:2108.05064
-
A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers-based Natural Language Processing Models 10 Aug 2021 · 0 repositories · arXiv:2108.04949
-
Adaptive Multi-Resolution Attention with Linear Complexity 10 Aug 2021 · 0 repositories · arXiv:2108.04962
-
AdaRNN: Adaptive Learning and Forecasting of Time Series 10 Aug 2021 · 2 repositories · arXiv:2108.04443
-
BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents 10 Aug 2021 · 2 repositories · arXiv:2108.04539Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples)
-
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation 10 Aug 2021 · 0 repositories · arXiv:2108.04556
-
Differentiable Subset Pruning of Transformer Heads 10 Aug 2021 · 2 repositories · arXiv:2108.04657
-
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion 10 Aug 2021 · 1 repository · arXiv:2108.04927
-
End-to-End User Behavior Retrieval in Click-Through RatePrediction Model 10 Aug 2021 · 1 repository · arXiv:2108.04468
-
FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpainting 10 Aug 2021 · 0 repositories · arXiv:2108.04424
-
TrUMAn: Trope Understanding in Movies and Animations 10 Aug 2021 · 0 repositories · arXiv:2108.04542
-
Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification 9 Aug 2021 · 1 repository · arXiv:2108.03886
-
DoSSIER@COLIEE 2021: Leveraging dense retrieval and summarization-based re-ranking for case law retrieval 9 Aug 2021 · 1 repository · arXiv:2108.03937
-
FiLMing Multimodal Sarcasm Detection with Attention 9 Aug 2021 · 1 repository · arXiv:2110.00416
-
IntenT5: Search Result Diversification using Causal Language Models 9 Aug 2021 · 0 repositories · arXiv:2108.04026
-
Making Transformers Solve Compositional Tasks 9 Aug 2021 · 1 repository · arXiv:2108.04378
-
Paint Transformer: Feed Forward Neural Painting with Stroke Prediction 9 Aug 2021 · 2 repositories · arXiv:2108.03798
-
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality? 9 Aug 2021 · 2 repositories · arXiv:2108.04384
-
The HW-TSC's Offline Speech Translation Systems for IWSLT 2021 Evaluation 9 Aug 2021 · 0 repositories · arXiv:2108.03845
-
Efficacy of BERT embeddings on predicting disaster from Twitter data 8 Aug 2021 · 1 repository · arXiv:2108.10698
-
Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims 8 Aug 2021 · 0 repositories · arXiv:2108.03731
-
Global Self-Attention as a Replacement for Graph Convolution 7 Aug 2021 · 3 repositories · arXiv:2108.03348Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition 7 Aug 2021 · 2 repositories · arXiv:2108.03354
-
PSViT: Better Vision Transformer via Token Pooling and Attention Sharing 7 Aug 2021 · 0 repositories · arXiv:2108.03428
-
Rethinking of AlphaStar 7 Aug 2021 · 2 repositories · arXiv:2108.03452
-
Vision Transformer for femur fracture classification 7 Aug 2021 · 0 repositories · arXiv:2108.03414
-
Deriving Disinformation Insights from Geolocalized Twitter Callouts 6 Aug 2021 · 1 repository · arXiv:2108.03067
-
Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning 6 Aug 2021 · 0 repositories · arXiv:2108.03305
-
Rollout event-triggered control: reconciling event- and time-triggered control 6 Aug 2021 · 0 repositories · arXiv:2108.02994
-
Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformer 6 Aug 2021 · 1 repository · arXiv:2108.03032Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
The Right to Talk: An Audio-Visual Transformer Approach 6 Aug 2021 · 1 repository · arXiv:2108.03256
-
Adaptive Residue-wise Profile Fusion for Low Homologous Protein SecondaryStructure Prediction Using External Knowledge 5 Aug 2021 · 0 repositories · arXiv:2108.04176
-
Decoupled Transformer for Scalable Inference in Open-domain Question Answering 5 Aug 2021 · 0 repositories · arXiv:2108.02765
-
Fast Convergence of DETR with Spatially Modulated Co-Attention 5 Aug 2021 · 1 repository · arXiv:2108.02404
-
Finetuning Pretrained Transformers into Variational Autoencoders 5 Aug 2021 · 1 repository · arXiv:2108.02446
-
Robust Transfer Learning with Pretrained Language Models through Adapters 5 Aug 2021 · 0 repositories · arXiv:2108.02340
-
RockGPT: Reconstructing three-dimensional digital rocks from single two-dimensional slice from the perspective of video generation 5 Aug 2021 · 0 repositories · arXiv:2108.03132
-
Sentiment Analysis on the News to Improve Mental Health 5 Aug 2021 · 0 repositories · arXiv:2108.07706
-
Token Shift Transformer for Video Classification 5 Aug 2021 · 3 repositories · arXiv:2108.02432Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Grounding 5 Aug 2021 · 0 repositories · arXiv:2108.02388