Methods › General › Attention Modules › Multi-Head Attention › Papers, page 203
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 203 of 249: papers 20,201 to 20,300 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Distributed Deep Learning in Open Collaborations 18 Jun 2021 · 2 repositories · arXiv:2106.10207Syntology official: harvested, nothing ran · 0 ran · 5 unverified (of 5 harvested samples)
-
End-to-end Temporal Action Detection with Transformer 18 Jun 2021 · 1 repository · arXiv:2106.10271Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Graph-based Joint Pandemic Concern and Relation Extraction on Twitter 18 Jun 2021 · 0 repositories · arXiv:2106.09929
-
Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasets 18 Jun 2021 · 0 repositories · arXiv:2106.10328
-
Recurrent Stacking of Layers in Neural Networks: An Application to Neural Machine Translation 18 Jun 2021 · 0 repositories · arXiv:2106.10002
-
Dual-view Molecule Pre-training 17 Jun 2021 · 1 repository · arXiv:2106.10234
-
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases 17 Jun 2021 · 1 repository · arXiv:2106.09231
-
Large Scale Private Learning via Low-rank Reparametrization 17 Jun 2021 · 1 repository · arXiv:2106.09352Syntology official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking 17 Jun 2021 · 1 repository · arXiv:2106.09795
-
Long-Short Temporal Contrastive Learning of Video Transformers 17 Jun 2021 · 0 repositories · arXiv:2106.09212
-
LoRA: Low-Rank Adaptation of Large Language Models 17 Jun 2021 · 74 repositories · arXiv:2106.09685Syntology community repositories only · 51 ran (of which 19 constructed an object rather than computing a result; 44 with no instrument failure: 1 honoured, 0 violated, 43 with no contract checked; 7 where Syntology's instrument failed) · 33 unverified (of 84 harvested samples) · 30 pointer-only (licence)
-
Multi-head or Single-head? An Empirical Comparison for Transformer Training 17 Jun 2021 · 1 repository · arXiv:2106.09650
-
Semi-Autoregressive Transformer for Image Captioning 17 Jun 2021 · 1 repository · arXiv:2106.09436
-
SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction 17 Jun 2021 · 6 repositories · arXiv:2106.09305Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples)
-
Algorithm to Compilation Co-design: An Integrated View of Neural Network Sparsity 16 Jun 2021 · 0 repositories · arXiv:2106.08846
-
End-to-End Semi-Supervised Object Detection with Soft Teacher 16 Jun 2021 · 8 repositories · arXiv:2106.09018
-
Grounding Spatio-Temporal Language with Transformers 16 Jun 2021 · 1 repository · arXiv:2106.08858
-
Model-Based Counterfactual Synthesizer for Interpretation 16 Jun 2021 · 0 repositories · arXiv:2106.08971
-
On Evaluation and Improvement of Tail Label Performance for Multi-label Text Classification 16 Jun 2021 · 0 repositories
-
Shuffle Transformer with Feature Alignment for Video Face Parsing 16 Jun 2021 · 0 repositories · arXiv:2106.08650
-
Masked Training of Neural Networks with Partial Gradients 16 Jun 2021 · 0 repositories · arXiv:2106.08895
-
TSSuBERT: Tweet Stream Summarization Using BERT 16 Jun 2021 · 1 repository · arXiv:2106.08770
-
An Automated Quality Evaluation Framework of Psychotherapy Conversations with Local Quality Estimates 15 Jun 2021 · 0 repositories · arXiv:2106.07922
-
ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling 15 Jun 2021 · 0 repositories · arXiv:2106.09532
-
BEiT: BERT Pre-Training of Image Transformers 15 Jun 2021 · 14 repositories · arXiv:2106.08254Syntology official (archive's flag): 1 ran · 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Incorporating Word Sense Disambiguation in Neural Language Models 15 Jun 2021 · 2 repositories · arXiv:2106.07967
-
BERT Embeddings for Automatic Readability Assessment 15 Jun 2021 · 1 repository · arXiv:2106.07935
-
Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention 15 Jun 2021 · 1 repository · arXiv:2106.07932
-
PairConnect: A Compute-Efficient MLP Alternative to Attention 15 Jun 2021 · 0 repositories · arXiv:2106.08235
-
Scene Transformer: A unified architecture for predicting multiple agent trajectories 15 Jun 2021 · 4 repositories · arXiv:2106.08417Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Textual Data Distributions: Kullback Leibler Textual Distributions Contrasts on GPT-2 Generated Texts, with Supervised, Unsupervised Learning on Vaccine & Market Topics & Sentiment 15 Jun 2021 · 0 repositories · arXiv:2107.02025
-
Can BERT Dig It? -- Named Entity Recognition for Information Retrieval in the Archaeology Domain 14 Jun 2021 · 0 repositories · arXiv:2106.07742
-
Dataset of Propaganda Techniques of the State-Sponsored Information Operation of the People's Republic of China 14 Jun 2021 · 1 repository · arXiv:2106.07544
-
End-to-end Neural Diarization: From Transformer to Conformer 14 Jun 2021 · 0 repositories · arXiv:2106.07167
-
Exploiting Sentence-Level Representations for Passage Ranking 14 Jun 2021 · 1 repository · arXiv:2106.07316
-
GPT3-to-plan: Extracting plans from text using GPT-3 14 Jun 2021 · 1 repository · arXiv:2106.07131
-
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units 14 Jun 2021 · 11 repositories · arXiv:2106.07447Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
Improved Transformer for High-Resolution GANs 14 Jun 2021 · 1 repository · arXiv:2106.07631Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Improving Paraphrase Detection with the Adversarial Paraphrasing Task 14 Jun 2021 · 1 repository · arXiv:2106.07691
-
Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces 14 Jun 2021 · 1 repository · arXiv:2106.07505
-
NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning 14 Jun 2021 · 1 repository · arXiv:2106.07454
-
Pre-Trained Models: Past, Present and Future 14 Jun 2021 · 0 repositories · arXiv:2106.07139
-
S²-MLP: Spatial-Shift MLP Architecture for Vision 14 Jun 2021 · 1 repository · arXiv:2106.07477
-
SAS: Self-Augmentation Strategy for Language Model Pre-training 14 Jun 2021 · 1 repository · arXiv:2106.07176
-
Why Can You Lay Off Heads? Investigating How BERT Heads Transfer 14 Jun 2021 · 0 repositories · arXiv:2106.07137
-
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping 13 Jun 2021 · 0 repositories · arXiv:2106.06905
-
Memory-efficient Transformers via Top-k Attention 13 Jun 2021 · 2 repositories · arXiv:2106.06899
-
Reinforcement Learning as One Big Sequence Modeling Problem 13 Jun 2021 · 1 repository
-
SASICM A Multi-Task Benchmark For Subtext Recognition 13 Jun 2021 · 0 repositories · arXiv:2106.06944
-
Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Models 13 Jun 2021 · 0 repositories · arXiv:2106.07047
-
The DEformer: An Order-Agnostic Distribution Estimating Transformer 13 Jun 2021 · 1 repository · arXiv:2106.06989Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Thinking Like Transformers 13 Jun 2021 · 5 repositories · arXiv:2106.06981Syntology official (archive's flag): 5 ran · 11 ran (of which 3 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 1 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 18 harvested samples) · 5 pointer-only (licence)
-
A Sentence-level Hierarchical BERT Model for Document Classification with Limited Labelled Data 12 Jun 2021 · 1 repository · arXiv:2106.06738
-
Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top-N Recommendation 12 Jun 2021 · 0 repositories · arXiv:2106.06722
-
DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation 12 Jun 2021 · 1 repository · arXiv:2106.06716Syntology official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Explaining the Deep Natural Language Processing by Mining Textual Interpretable Features 12 Jun 2021 · 0 repositories · arXiv:2106.06697
-
Neural Combinatory Constituency Parsing 12 Jun 2021 · 1 repository · arXiv:2106.06689
-
Video Super-Resolution Transformer 12 Jun 2021 · 1 repository · arXiv:2106.06847
-
BioELECTRA:Pretrained Biomedical text Encoder using Discriminators 11 Jun 2021 · 1 repository
-
Break-It-Fix-It: Unsupervised Learning for Program Repair 11 Jun 2021 · 1 repository · arXiv:2106.06600Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Dynamic Language Models for Continuously Evolving Content 11 Jun 2021 · 0 repositories · arXiv:2106.06297
-
Generate, Annotate, and Learn: NLP with Synthetic Text 11 Jun 2021 · 1 repository · arXiv:2106.06168Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNs 11 Jun 2021 · 1 repository · arXiv:2106.06218
-
Isolated Sign Recognition from RGB Video using Pose Flow and Self-Attention 11 Jun 2021 · 1 repository
-
MlTr: Multi-label Classification with Transformer 11 Jun 2021 · 1 repository · arXiv:2106.06195
-
Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation 11 Jun 2021 · 1 repository · arXiv:2106.06165
-
N-Best ASR Transformer: Enhancing SLU Performance using Multiple ASR Hypotheses 11 Jun 2021 · 1 repository · arXiv:2106.06519
-
Neural Symbolic Regression that Scales 11 Jun 2021 · 2 repositories · arXiv:2106.06427Syntology official: harvested, nothing ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 7 harvested samples)
-
RefBERT: Compressing BERT by Referencing to Pre-computed Representations 11 Jun 2021 · 0 repositories · arXiv:2106.08898
-
ViT-Inception-GAN for Image Colourising 11 Jun 2021 · 0 repositories · arXiv:2106.06321
-
A Semi-supervised Multi-task Learning Approach to Classify Customer Contact Intents 10 Jun 2021 · 0 repositories · arXiv:2106.07381
-
AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT 10 Jun 2021 · 1 repository · arXiv:2106.14625
-
CAT: Cross Attention in Vision Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05786Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models 10 Jun 2021 · 1 repository · arXiv:2106.05505
-
Cross-lingual Emotion Detection 10 Jun 2021 · 0 repositories · arXiv:2106.06017
-
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures 10 Jun 2021 · 0 repositories · arXiv:2106.05822
-
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation 10 Jun 2021 · 1 repository · arXiv:2106.05691Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
MST: Masked Self-Supervised Transformer for Visual Representation 10 Jun 2021 · 0 repositories · arXiv:2106.05656
-
Programming Puzzles 10 Jun 2021 · 3 repositories · arXiv:2106.05784
-
Scaling Vision with Sparse Mixture of Experts 10 Jun 2021 · 1 repository · arXiv:2106.05974Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Semantic-aware Binary Code Representation with BERT 10 Jun 2021 · 0 repositories · arXiv:2106.05478
-
Space-time Mixing Attention for Video Transformer 10 Jun 2021 · 1 repository · arXiv:2106.05968Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS 10 Jun 2021 · 0 repositories
-
Automatic Sexism Detection with Multilingual Transformer Models 9 Jun 2021 · 0 repositories · arXiv:2106.04908
-
Do Transformers Really Perform Bad for Graph Representation? 9 Jun 2021 · 5 repositories · arXiv:2106.05234
-
Grounding inductive biases in natural images:invariance stems from variations in data 9 Jun 2021 · 1 repository · arXiv:2106.05121Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding 9 Jun 2021 · 1 repository · arXiv:2106.04970Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Phraseformer: Multimodal Key-phrase Extraction using Transformer and Graph Embedding 9 Jun 2021 · 0 repositories · arXiv:2106.04939
-
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer 9 Jun 2021 · 0 repositories · arXiv:2106.04833
-
Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time 9 Jun 2021 · 1 repository · arXiv:2106.05266
-
Sentence Embeddings using Supervised Contrastive Learning 9 Jun 2021 · 1 repository · arXiv:2106.04791
-
Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action Recognition 9 Jun 2021 · 1 repository · arXiv:2106.05058
-
A Survey of Transformers 8 Jun 2021 · 2 repositories · arXiv:2106.04554
-
A Unified Generative Framework for Aspect-Based Sentiment Analysis 8 Jun 2021 · 3 repositories · arXiv:2106.04300
-
Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Reading 8 Jun 2021 · 1 repository · arXiv:2106.04134
-
On the Connection between Local Attention and Dynamic Depth-wise Convolution 8 Jun 2021 · 1 repository · arXiv:2106.04263Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 1 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 9 pointer-only (licence)
-
DETReg: Unsupervised Pretraining with Region Priors for Object Detection 8 Jun 2021 · 1 repository · arXiv:2106.04550Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer 8 Jun 2021 · 0 repositories · arXiv:2106.04095
-
Engines of Power: Electricity, AI, and General-Purpose Military Transformations 8 Jun 2021 · 0 repositories · arXiv:2106.04338
-
FastSeq: Make Sequence Generation Faster 8 Jun 2021 · 1 repository · arXiv:2106.04718