Methods › General › Attention Modules › Multi-Head Attention › Papers, page 207
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 207 of 249: papers 20,601 to 20,700 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
EL-Attention: Memory Efficient Lossless Attention for Generation 11 May 2021 · 1 repository · arXiv:2105.04779Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection 11 May 2021 · 0 repositories · arXiv:2105.05112
-
Role of Artificial Intelligence in Detection of Hateful Speech for Hinglish Data on Social Media 11 May 2021 · 0 repositories · arXiv:2105.04913
-
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models 10 May 2021 · 0 repositories · arXiv:2105.04688
-
Automatic Classification of Human Translation and Machine Translation: A Study from the Perspective of Lexical Diversity 10 May 2021 · 0 repositories · arXiv:2105.04616
-
Learning Robust Latent Representations for Controllable Speech Synthesis 10 May 2021 · 0 repositories · arXiv:2105.04458
-
Matching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning 10 May 2021 · 1 repository · arXiv:2105.04143
-
MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAE 10 May 2021 · 1 repository · arXiv:2105.04090Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey 10 May 2021 · 0 repositories · arXiv:2105.04387
-
RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representation 10 May 2021 · 0 repositories · arXiv:2105.04322
-
Self-Guided Curriculum Learning for Neural Machine Translation 10 May 2021 · 0 repositories · arXiv:2105.04475
-
Self-Supervised Learning with Swin Transformers 10 May 2021 · 6 repositories · arXiv:2105.04553
-
SRLF: A Stance-aware Reinforcement Learning Framework for Content-based Rumor Detection on Social Media 10 May 2021 · 0 repositories · arXiv:2105.04098
-
FNet: Mixing Tokens with Fourier Transforms 9 May 2021 · 12 repositories · arXiv:2105.03824Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
TrTr: Visual Tracking with Transformer 9 May 2021 · 1 repository · arXiv:2105.03817
-
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention 9 May 2021 · 0 repositories · arXiv:2105.03928
-
e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks 8 May 2021 · 2 repositories · arXiv:2105.03761Syntology official (archive's flag): 5 ran · 7 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
Falling Through the Gaps: Neural Architectures as Models of Morphological Rule Learning 8 May 2021 · 1 repository · arXiv:2105.03710
-
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning 8 May 2021 · 3 repositories · arXiv:2105.03654Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer 8 May 2021 · 0 repositories · arXiv:2105.03775
-
Adapting by Pruning: A Case Study on BERT 7 May 2021 · 1 repository · arXiv:2105.03343
-
Are Pre-trained Convolutions Better than Pre-trained Transformers? 7 May 2021 · 1 repository · arXiv:2105.03322
-
Efficient Weight factorization for Multilingual Speech Recognition 7 May 2021 · 0 repositories · arXiv:2105.03010
-
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality 7 May 2021 · 1 repository · arXiv:2105.03484
-
MOTR: End-to-End Multiple-Object Tracking with Transformer 7 May 2021 · 2 repositories · arXiv:2105.03247
-
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts 7 May 2021 · 1 repository · arXiv:2105.03023Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts 7 May 2021 · 1 repository · arXiv:2105.03036
-
Understanding by Understanding Not: Modeling Negation in Language Models 7 May 2021 · 1 repository · arXiv:2105.03519
-
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High 6 May 2021 · 1 repository · arXiv:2105.02855
-
Aligning Subtitles in Sign Language Videos 6 May 2021 · 0 repositories · arXiv:2105.02877
-
Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach 6 May 2021 · 1 repository · arXiv:2105.02629
-
Introducing Information Retrieval for Biomedical Informatics Students 6 May 2021 · 1 repository · arXiv:2105.02746
-
On the logistical difficulties and findings of Jopara Sentiment Analysis 6 May 2021 · 1 repository · arXiv:2105.02947
-
TABBIE: Pretrained Representations of Tabular Data 6 May 2021 · 2 repositories · arXiv:2105.02584
-
Attention for Image Registration (AiR): an unsupervised Transformer approach 5 May 2021 · 1 repository · arXiv:2105.02282
-
FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstruction 5 May 2021 · 1 repository · arXiv:2105.01937Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Instances as Queries 5 May 2021 · 5 repositories · arXiv:2105.01928Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Encoding Weights of Irregular Sparsity for Fixed-to-Fixed Model Compression 5 May 2021 · 0 repositories · arXiv:2105.01869
-
TransHash: Transformer-based Hamming Hashing for Efficient Image Retrieval 5 May 2021 · 0 repositories · arXiv:2105.01823
-
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries 5 May 2021 · 0 repositories · arXiv:2105.02170
-
MLP-Mixer: An all-MLP Architecture for Vision 4 May 2021 · 49 repositories · arXiv:2105.01601Syntology official: harvested, nothing ran · 114 ran (of which 77 constructed an object rather than computing a result; 105 with no instrument failure: 2 honoured, 0 violated, 103 with no contract checked; 9 where Syntology's instrument failed) · 20 unverified (of 134 harvested samples) · 40 pointer-only (licence)
-
Moving Towards Centers: Re-ranking with Attention and Memory for Re-identification 4 May 2021 · 0 repositories · arXiv:2105.01447
-
Retrieving Complex Tables with Multi-Granular Graph Representation Learning 4 May 2021 · 1 repository · arXiv:2105.01736Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review 3 May 2021 · 0 repositories · arXiv:2105.01044
-
ISTR: End-to-End Instance Segmentation with Transformers 3 May 2021 · 1 repository · arXiv:2105.00637
-
One Model to Rule them All: Towards Zero-Shot Learning for Databases 3 May 2021 · 0 repositories · arXiv:2105.00642
-
SmoothI: Smooth Rank Indicators for Differentiable IR Metrics 3 May 2021 · 1 repository · arXiv:2105.00942
-
Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks 3 May 2021 · 0 repositories · arXiv:2105.01192
-
AGMB-Transformer: Anatomy-Guided Multi-Branch Transformer Network for Automated Evaluation of Root Canal Therapy 2 May 2021 · 1 repository · arXiv:2105.00381
-
MathBERT: A Pre-Trained Model for Mathematical Formula Understanding 2 May 2021 · 0 repositories · arXiv:2105.00377
-
Audio Transformers 1 May 2021 · 0 repositories · arXiv:2105.00335
-
Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation 1 May 2021 · 1 repository · arXiv:2105.00250
-
MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization 1 May 2021 · 1 repository · arXiv:2105.00239
-
SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition 1 May 2021 · 0 repositories · arXiv:2105.00149
-
When to Fold'em: How to answer Unanswerable questions 1 May 2021 · 1 repository · arXiv:2105.00328
-
BERT Meets Relational DB: Contextual Representations of Relational Databases 30 Apr 2021 · 0 repositories · arXiv:2104.14914
-
CAT: Cross-Attention Transformer for One-Shot Object Detection 30 Apr 2021 · 0 repositories · arXiv:2104.14984
-
Chop Chop BERT: Visual Question Answering by Chopping VisualBERT's Heads 30 Apr 2021 · 0 repositories · arXiv:2104.14741
-
CoSformer: Detecting Co-Salient Object with Transformers 30 Apr 2021 · 0 repositories · arXiv:2104.14729
-
CTLR@WiC-TSV: Target Sense Verification using Marked Inputs andPre-trained Models 30 Apr 2021 · 0 repositories
-
GTN-ED: Event Detection Using Graph Transformer Networks 30 Apr 2021 · 0 repositories · arXiv:2104.15104
-
Mitigating Political Bias in Language Models Through Reinforced Calibration 30 Apr 2021 · 0 repositories · arXiv:2104.14795
-
Word Sense Disambiguation with Transformer Models 30 Apr 2021 · 0 repositories
-
AMR Parsing with Action-Pointer Transformer 29 Apr 2021 · 1 repository · arXiv:2104.14674Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Emerging Properties in Self-Supervised Vision Transformers 29 Apr 2021 · 32 repositories · arXiv:2104.14294Syntology official: no sample here; runs from other or unrecorded repositories · 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 1 violated, 9 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 20 harvested samples) · 4 pointer-only (licence)
-
Entailment as Few-Shot Learner 29 Apr 2021 · 3 repositories · arXiv:2104.14690Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathological Image Detection 29 Apr 2021 · 0 repositories · arXiv:2104.14528
-
Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation 29 Apr 2021 · 1 repository · arXiv:2104.14639
-
Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses 29 Apr 2021 · 1 repository · arXiv:2104.14694
-
Pyramid Medical Transformer for Medical Image Segmentation 29 Apr 2021 · 0 repositories · arXiv:2104.14702
-
Using Adaptive Gradient for Texture Learning in Single-View 3D Reconstruction 29 Apr 2021 · 0 repositories · arXiv:2104.14169
-
An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG 28 Apr 2021 · 1 repository
-
Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction 28 Apr 2021 · 1 repository · arXiv:2104.13913
-
Inpainting Transformer for Anomaly Detection 28 Apr 2021 · 2 repositories · arXiv:2104.13897Syntology 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Medical Transformer: Universal Brain Encoder for 3D MRI Analysis 28 Apr 2021 · 0 repositories · arXiv:2104.13633
-
MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories 28 Apr 2021 · 1 repository · arXiv:2104.13615Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Multi-Task Learning of Query Intent and Named Entities using Transfer Learning 28 Apr 2021 · 0 repositories · arXiv:2105.03316
-
Point Cloud Learning with Transformer 28 Apr 2021 · 0 repositories · arXiv:2104.13636
-
Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers 28 Apr 2021 · 1 repository · arXiv:2104.13640
-
Twins: Revisiting the Design of Spatial Attention in Vision Transformers 28 Apr 2021 · 9 repositories · arXiv:2104.13840Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Dual Transformer for Point Cloud Analysis 27 Apr 2021 · 0 repositories · arXiv:2104.13044
-
Extractive and Abstractive Explanations for Fact-Checking and Evaluation of News 27 Apr 2021 · 0 repositories · arXiv:2104.12918
-
Generating Lead Sheets with Affect: A Novel Conditional seq2seq Framework 27 Apr 2021 · 1 repository · arXiv:2104.13056
-
Multi-class Text Classification using BERT-based Active Learning 27 Apr 2021 · 0 repositories · arXiv:2104.14289
-
Semi-supervised Interactive Intent Labeling 27 Apr 2021 · 0 repositories · arXiv:2104.13406
-
UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter 27 Apr 2021 · 0 repositories · arXiv:2104.13164
-
Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attention 26 Apr 2021 · 0 repositories · arXiv:2104.12874
-
Diverse Image Inpainting with Bidirectional and Autoregressive Transformers 26 Apr 2021 · 0 repositories · arXiv:2104.12335
-
Easy and Efficient Transformer : Scalable Inference Solution For large NLP model 26 Apr 2021 · 1 repository · arXiv:2104.12470
-
Focused Attention Improves Document-Grounded Generation 26 Apr 2021 · 1 repository · arXiv:2104.12714
-
Head-synchronous Decoding for Transformer-based Streaming ASR 26 Apr 2021 · 0 repositories · arXiv:2104.12631
-
Vision Transformers with Patch Diversification 26 Apr 2021 · 1 repository · arXiv:2104.12753
-
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding 26 Apr 2021 · 5 repositories · arXiv:2104.12763Syntology community repositories only · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation 26 Apr 2021 · 5 repositories · arXiv:2104.12369
-
Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis 26 Apr 2021 · 1 repository · arXiv:2104.12395
-
Rich Semantics Improve Few-shot Learning 26 Apr 2021 · 0 repositories · arXiv:2104.12709
-
Visformer: The Vision-friendly Transformer 26 Apr 2021 · 5 repositories · arXiv:2104.12533Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Potential Idiomatic Expression (PIE)-English: Corpus for Classes of Idioms 25 Apr 2021 · 2 repositories · arXiv:2105.03280
-
A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images 25 Apr 2021 · 1 repository · arXiv:2104.12137Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Visual Saliency Transformer 25 Apr 2021 · 2 repositories · arXiv:2104.12099Syntology 7 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 11 pointer-only (licence)