Methods › General › Attention Mechanisms › Attention › Papers, page 268
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 268 of 316: papers 26,701 to 26,800 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Transformer-based Machine Learning for Fast SAT Solvers and Logic Synthesis 15 Jul 2021 · 1 repository · arXiv:2107.07116
-
Trusting RoBERTa over BERT: Insights from CheckListing the Natural Language Inference Task 15 Jul 2021 · 1 repository · arXiv:2107.07229
-
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills 15 Jul 2021 · 1 repository · arXiv:2107.07261
-
A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer 14 Jul 2021 · 1 repository · arXiv:2107.06573
-
BERT Fine-Tuning for Sentiment Analysis on Indonesian Mobile Apps Reviews 14 Jul 2021 · 0 repositories · arXiv:2107.06802
-
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines 14 Jul 2021 · 1 repository · arXiv:2107.06925
-
Single Event Transition Risk: A Measure for Long Term Carbon Exposure 14 Jul 2021 · 0 repositories · arXiv:2107.06518
-
Indonesia's Fake News Detection using Transformer Network 14 Jul 2021 · 1 repository · arXiv:2107.06796
-
Large-Scale News Classification using BERT Language Model: Spark NLP Approach 14 Jul 2021 · 0 repositories · arXiv:2107.06785
-
Scalable Memory Protection in the PENGLAI Enclave 14 Jul 2021 · 1 repository
-
Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding 14 Jul 2021 · 0 repositories · arXiv:2107.06493
-
CMT: Convolutional Neural Networks Meet Vision Transformers 13 Jul 2021 · 14 repositories · arXiv:2107.06263Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
Exploiting Network Structures to Improve Semantic Representation for the Financial Domain 13 Jul 2021 · 0 repositories · arXiv:2107.05885
-
HAT: Hierarchical Aggregation Transformers for Person Re-identification 13 Jul 2021 · 1 repository · arXiv:2107.05946
-
Rating Facts under Coarse-to-fine Regimes 13 Jul 2021 · 0 repositories · arXiv:2107.06051
-
The Piano Inpainting Application 13 Jul 2021 · 2 repositories · arXiv:2107.05944
-
TSCAN : Dialog Structure discovery using SCAN 13 Jul 2021 · 0 repositories · arXiv:2107.06426
-
Using BERT Encoding to Tackle the Mad-lib Attack in SMS Spam Detection 13 Jul 2021 · 1 repository · arXiv:2107.06400
-
What do writing features tell us about AI papers? 13 Jul 2021 · 1 repository · arXiv:2107.06310
-
A Flexible Multi-Task Model for BERT Serving 12 Jul 2021 · 1 repository · arXiv:2107.05377
-
Asking Clarifying Questions Based on Negative Feedback in Conversational Search 12 Jul 2021 · 0 repositories · arXiv:2107.05760
-
CoBERL: Contrastive BERT for Reinforcement Learning 12 Jul 2021 · 2 repositories · arXiv:2107.05431Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
COPER: a Query-adaptable Semantics-based Search Engine for Persian COVID-19 Articles 12 Jul 2021 · 1 repository · arXiv:2107.05722
-
MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition 12 Jul 2021 · 1 repository · arXiv:2107.05418
-
BERT-like Pre-training for Symbolic Piano Music Classification Tasks 12 Jul 2021 · 1 repository · arXiv:2107.05223
-
MOOCRep: A Unified Pre-trained Embedding of MOOC Entities 12 Jul 2021 · 1 repository · arXiv:2107.05154
-
Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff 12 Jul 2021 · 1 repository · arXiv:2107.05693Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Split, embed and merge: An accurate table structure recognizer 12 Jul 2021 · 0 repositories · arXiv:2107.05214
-
TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation 12 Jul 2021 · 1 repository · arXiv:2107.05274
-
Visual Transformer with Statistical Test for COVID-19 Classification 12 Jul 2021 · 0 repositories · arXiv:2107.05334
-
Transformers with multi-modal features and post-fusion context for e-commerce session-based recommendation 11 Jul 2021 · 0 repositories · arXiv:2107.05124
-
Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations 10 Jul 2021 · 3 repositories · arXiv:2107.04746
-
Few-Shot Domain Adaptation with Polymorphic Transformers 10 Jul 2021 · 1 repository · arXiv:2107.04805
-
Local-to-Global Self-Attention in Vision Transformers 10 Jul 2021 · 0 repositories · arXiv:2107.04735
-
Noise Stability Regularization for Improving BERT Fine-tuning 10 Jul 2021 · 0 repositories · arXiv:2107.04835
-
Read, Attend, and Code: Pushing the Limits of Medical Codes Prediction from Clinical Notes by Machines 10 Jul 2021 · 0 repositories · arXiv:2107.10650
-
An Initial Investigation of Non-Native Spoken Question-Answering 9 Jul 2021 · 0 repositories · arXiv:2107.04691
-
Can Deep Neural Networks Predict Data Correlations from Column Names? 9 Jul 2021 · 1 repository · arXiv:2107.04553
-
A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer Models 8 Jul 2021 · 2 repositories · arXiv:2107.03844
-
Affect Expression Behaviour Analysis in the Wild using Consensual Collaborative Training 8 Jul 2021 · 1 repository · arXiv:2107.05736
-
Calliope -- A Polyphonic Music Transformer 8 Jul 2021 · 0 repositories · arXiv:2107.05546
-
Learning to Delegate for Large-scale Vehicle Routing 8 Jul 2021 · 1 repository · arXiv:2107.04139Syntology official: harvested, nothing ran · 0 ran · 6 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
BumbleBee: A Transformer for Music 7 Jul 2021 · 0 repositories · arXiv:2107.03443
-
Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test 7 Jul 2021 · 1 repository · arXiv:2107.03448
-
Efficient Transformer for Direct Speech Translation 7 Jul 2021 · 0 repositories · arXiv:2107.03069
-
Evaluating Large Language Models Trained on Code 7 Jul 2021 · 13 repositories · arXiv:2107.03374Syntology official (archive's flag): 2 ran · 26 ran (of which 0 constructed an object rather than computing a result; 24 with no instrument failure: 1 honoured, 0 violated, 23 with no contract checked; 2 where Syntology's instrument failed) · 13 unverified (of 39 harvested samples) · 4 pointer-only (licence)
-
GLiT: Neural Architecture Search for Global and Local Image Transformer 7 Jul 2021 · 2 repositories · arXiv:2107.02960Syntology community repositories only · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples)
-
Identifying Hijacked Reviews 7 Jul 2021 · 0 repositories · arXiv:2107.05385
-
LanguageRefer: Spatial-Language Model for 3D Visual Grounding 7 Jul 2021 · 0 repositories · arXiv:2107.03438
-
Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition 7 Jul 2021 · 0 repositories · arXiv:2107.03107
-
MACCIF-TDNN: Multi aspect aggregation of channel and context interdependence features in TDNN-based speaker verification 7 Jul 2021 · 0 repositories · arXiv:2107.03104
-
Model Selection for Generic Contextual Bandits 7 Jul 2021 · 0 repositories · arXiv:2107.03455
-
Not Quite 'Ask a Librarian': AI on the Nature, Value, and Future of LIS 7 Jul 2021 · 0 repositories · arXiv:2107.05383
-
Scopeformer: n-CNN-ViT Hybrid Model for Intracranial Hemorrhage Classification 7 Jul 2021 · 0 repositories · arXiv:2107.04575
-
Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World 7 Jul 2021 · 1 repository · arXiv:2107.03172
-
Transformer Network for Significant Stenosis Detection in CCTA of Coronary Arteries 7 Jul 2021 · 1 repository · arXiv:2107.03035
-
Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation 6 Jul 2021 · 0 repositories · arXiv:2107.02655
-
COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architectures 6 Jul 2021 · 0 repositories · arXiv:2107.02672
-
Detecting Hypo-plastic Left Heart Syndrome in Fetal Ultrasound via Disease-specific Atlas Maps 6 Jul 2021 · 0 repositories · arXiv:2107.02643
-
Feature Fusion Vision Transformer for Fine-Grained Visual Categorization 6 Jul 2021 · 1 repository · arXiv:2107.02341
-
Point Cloud Registration using Representative Overlapping Points 6 Jul 2021 · 1 repository · arXiv:2107.02583Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples)
-
Contradiction Detection in Persian Text 5 Jul 2021 · 0 repositories · arXiv:2107.01987
-
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation 5 Jul 2021 · 2 repositories · arXiv:2107.02137
-
Experiments with adversarial attacks on text genres 5 Jul 2021 · 0 repositories · arXiv:2107.02246
-
Long-Short Transformer: Efficient Transformers for Language and Vision 5 Jul 2021 · 3 repositories · arXiv:2107.02192Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
Test-Time Personalization with a Transformer for Human Pose Estimation 5 Jul 2021 · 0 repositories · arXiv:2107.02133
-
Vision Xformers: Efficient Attention for Image Classification 5 Jul 2021 · 2 repositories · arXiv:2107.02239
-
What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition 5 Jul 2021 · 1 repository · arXiv:2107.02294
-
What Makes for Hierarchical Vision Transformer? 5 Jul 2021 · 0 repositories · arXiv:2107.02174
-
COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models 4 Jul 2021 · 1 repository · arXiv:2107.01682
-
End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baseline 4 Jul 2021 · 0 repositories · arXiv:2107.01700
-
Introducing Self-Attention to Target Attentive Graph Neural Networks 4 Jul 2021 · 1 repository · arXiv:2107.01516
-
KAISA: An Adaptive Second-Order Optimizer Framework for Deep Neural Networks 4 Jul 2021 · 3 repositories · arXiv:2107.01739Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN 3 Jul 2021 · 0 repositories · arXiv:2107.01366
-
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation 3 Jul 2021 · 1 repository · arXiv:2107.01378
-
Supervised Off-Policy Ranking 3 Jul 2021 · 1 repository · arXiv:2107.01360Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Case Relation Transformer: A Crossmodal Language Generation Model for Fetching Instructions 2 Jul 2021 · 0 repositories · arXiv:2107.00789
-
Cross-view Geo-localization with Evolving Transformer 2 Jul 2021 · 0 repositories · arXiv:2107.00842
-
He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics 2 Jul 2021 · 1 repository · arXiv:2107.00807
-
Language Identification of Hindi-English tweets using code-mixed BERT 2 Jul 2021 · 0 repositories · arXiv:2107.01202
-
Online Metro Origin-Destination Prediction via Heterogeneous Information Aggregation 2 Jul 2021 · 1 repository · arXiv:2107.00946
-
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling 2 Jul 2021 · 1 repository · arXiv:2107.00967
-
Relaxed Attention: A Simple Method to Boost Performance of End-to-End Automatic Speech Recognition 2 Jul 2021 · 1 repository · arXiv:2107.01275
-
Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Text 2 Jul 2021 · 0 repositories · arXiv:2107.01294
-
Solving Machine Learning Problems 2 Jul 2021 · 1 repository · arXiv:2107.01238
-
Target-dependent UNITER: A Transformer-Based Multimodal Language Comprehension Model for Domestic Service Robots 2 Jul 2021 · 0 repositories · arXiv:2107.00811
-
Transformer-F: A Transformer network with effective methods for learning universal sentence representation 2 Jul 2021 · 0 repositories · arXiv:2107.00653
-
Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation 2 Jul 2021 · 1 repository · arXiv:2107.00977
-
UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation 2 Jul 2021 · 1 repository · arXiv:2107.00781
-
Visual Relationship Forecasting in Videos 2 Jul 2021 · 0 repositories · arXiv:2107.01181
-
A Primer on Pretrained Multilingual Language Models 1 Jul 2021 · 0 repositories · arXiv:2107.00676
-
Action Transformer: A Self-Attention Model for Short-Time Pose-Based Human Action Recognition 1 Jul 2021 · 4 repositories · arXiv:2107.00606
-
AutoFormer: Searching Transformers for Visual Recognition 1 Jul 2021 · 2 repositories · arXiv:2107.00651
-
Cross-Lingual Transfer Learning for Statistical Type Inference 1 Jul 2021 · 0 repositories · arXiv:2107.00157
-
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows 1 Jul 2021 · 7 repositories · arXiv:2107.00652Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Elbert: Fast Albert with Confidence-Window Based Early Exit 1 Jul 2021 · 0 repositories · arXiv:2107.00175
-
Focal Self-attention for Local-Global Interactions in Vision Transformers 1 Jul 2021 · 3 repositories · arXiv:2107.00641Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph 1 Jul 2021 · 0 repositories · arXiv:2107.00395
-
Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation 1 Jul 2021 · 0 repositories · arXiv:2107.00316
-
Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction 1 Jul 2021 · 1 repository · arXiv:2107.00596