Methods › General › Attention Modules › Multi-Head Attention › Papers, page 192
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 192 of 249: papers 19,101 to 19,200 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models 14 Oct 2021 · 1 repository · arXiv:2110.07178
-
The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization 14 Oct 2021 · 1 repository · arXiv:2110.07732Syntology official (archive's flag): 7 ran · 7 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
Transformer for Polyp Detection 14 Oct 2021 · 0 repositories · arXiv:2111.07918
-
CLIP4Caption: CLIP for Video Caption 13 Oct 2021 · 0 repositories · arXiv:2110.06615
-
Leveraging Generative Models for Covert Messaging: Challenges and Tradeoffs for "Dead-Drop" Deployments 13 Oct 2021 · 0 repositories · arXiv:2110.07009
-
Fake News Detection in Spanish Using Deep Learning Techniques 13 Oct 2021 · 1 repository · arXiv:2110.06461
-
Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings 13 Oct 2021 · 1 repository · arXiv:2110.06446Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Language Modelling via Learning to Rank 13 Oct 2021 · 0 repositories · arXiv:2110.06961
-
Leveraging redundancy in attention with Reuse Transformers 13 Oct 2021 · 1 repository · arXiv:2110.06821
-
Maximizing Efficiency of Language Model Pre-training for Learning Representation 13 Oct 2021 · 0 repositories · arXiv:2110.06620
-
MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction 13 Oct 2021 · 1 repository · arXiv:2110.06651
-
Multistage linguistic conditioning of convolutional layers for speech emotion recognition 13 Oct 2021 · 0 repositories · arXiv:2110.06650
-
Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers 13 Oct 2021 · 0 repositories · arXiv:2110.06990
-
Semantics-aware Attention Improves Neural Machine Translation 13 Oct 2021 · 0 repositories · arXiv:2110.06920
-
Study of positional encoding approaches for Audio Spectrogram Transformers 13 Oct 2021 · 1 repository · arXiv:2110.06999
-
The Dawn of Quantum Natural Language Processing 13 Oct 2021 · 2 repositories · arXiv:2110.06510
-
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline 13 Oct 2021 · 1 repository · arXiv:2110.07038
-
Transform and Bitstream Domain Image Classification 13 Oct 2021 · 0 repositories · arXiv:2110.06740
-
Understanding of Emotion Perception from Art 13 Oct 2021 · 0 repositories · arXiv:2110.06486
-
Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting 13 Oct 2021 · 1 repository · arXiv:2110.08255
-
Regionalized models for Spanish language variations based on Twitter 12 Oct 2021 · 0 repositories · arXiv:2110.06128
-
ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality 12 Oct 2021 · 0 repositories · arXiv:2110.06376
-
Attention-guided Generative Models for Extractive Question Answering 12 Oct 2021 · 0 repositories · arXiv:2110.06393
-
BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communications 12 Oct 2021 · 2 repositories · arXiv:2110.05781
-
Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation 12 Oct 2021 · 2 repositories · arXiv:2110.05730Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer 12 Oct 2021 · 1 repository · arXiv:2110.05999
-
Dynamic Inference with Neural Interpreters 12 Oct 2021 · 0 repositories · arXiv:2110.06399
-
Extracting Feelings of People Regarding COVID-19 by Social Network Mining 12 Oct 2021 · 0 repositories · arXiv:2110.06151
-
HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization 12 Oct 2021 · 1 repository · arXiv:2110.06388
-
LightSeq2: Accelerated Training for Transformer-based Models on GPUs 12 Oct 2021 · 1 repository · arXiv:2110.05722
-
LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learners 12 Oct 2021 · 1 repository · arXiv:2110.06274Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 4 pointer-only (licence)
-
Mention Memory: incorporating textual knowledge into Transformers through entity mention attention 12 Oct 2021 · 1 repository · arXiv:2110.06176
-
Relative Molecule Self-Attention Transformer 12 Oct 2021 · 1 repository · arXiv:2110.05841Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Rescoring Sequence-to-Sequence Models for Text Line Recognition with CTC-Prefixes 12 Oct 2021 · 1 repository · arXiv:2110.05909
-
Satellite Image Semantic Segmentation 12 Oct 2021 · 1 repository · arXiv:2110.05812
-
StARformer: Transformer with State-Action-Reward Representations for Visual Reinforcement Learning 12 Oct 2021 · 1 repository · arXiv:2110.06206Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimation 11 Oct 2021 · 0 repositories · arXiv:2110.05092
-
Certified Patch Robustness via Smoothed Vision Transformers 11 Oct 2021 · 1 repository · arXiv:2110.07719Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 3 pointer-only (licence)
-
Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgetting 11 Oct 2021 · 0 repositories · arXiv:2110.05367
-
Investigating Transfer Learning Capabilities of Vision Transformers and CNNs by Fine-Tuning a Single Trainable Block 11 Oct 2021 · 1 repository · arXiv:2110.05270
-
Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems 11 Oct 2021 · 0 repositories · arXiv:2110.05221
-
Multi-View Self-Attention Based Transformer for Speaker Recognition 11 Oct 2021 · 0 repositories · arXiv:2110.05036
-
Offensive Language Detection with BERT-based models, By Customizing Attention Probabilities 11 Oct 2021 · 0 repositories · arXiv:2110.05133
-
Partial Variable Training for Efficient On-Device Federated Learning 11 Oct 2021 · 0 repositories · arXiv:2110.05607
-
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition 11 Oct 2021 · 0 repositories · arXiv:2110.05571
-
Topic Modeling, Clade-assisted Sentiment Analysis, and Vaccine Brand Reputation Analysis of COVID-19 Vaccine-related Facebook Comments in the Philippines 11 Oct 2021 · 1 repository · arXiv:2111.04416
-
Unsupervised Source Separation via Bayesian Inference in the Latent Domain 11 Oct 2021 · 1 repository · arXiv:2110.05313
-
DCT: Dynamic Compressive Transformer for Modeling Unbounded Sequence 10 Oct 2021 · 0 repositories · arXiv:2110.04821
-
Multi-Channel End-to-End Neural Diarization with Distributed Microphones 10 Oct 2021 · 0 repositories · arXiv:2110.04694
-
Global Vision Transformer Pruning with Hessian-Aware Saliency 10 Oct 2021 · 1 repository · arXiv:2110.04869Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Automatic Text Extractive Summarization Based on Graph and Pre-trained Language Model Attention 10 Oct 2021 · 0 repositories · arXiv:2110.04878
-
PASTE: A Tagging-Free Decoding Framework Using Pointer Networks for Aspect Sentiment Triplet Extraction 10 Oct 2021 · 1 repository · arXiv:2110.04794
-
SP-GPT2: Semantics Improvement in Vietnamese Poetry Generation 10 Oct 2021 · 2 repositories · arXiv:2110.15723
-
SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions 10 Oct 2021 · 0 repositories · arXiv:2110.04711
-
Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning 10 Oct 2021 · 1 repository · arXiv:2110.04725
-
An Isotropy Analysis in the Multilingual BERT Embedding Space 9 Oct 2021 · 1 repository · arXiv:2110.04504
-
Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Prediction 9 Oct 2021 · 1 repository · arXiv:2110.04475
-
Vector-quantized Image Modeling with Improved VQGAN 9 Oct 2021 · 5 repositories · arXiv:2110.04627Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
Vision Transformer based COVID-19 Detection using Chest X-rays 9 Oct 2021 · 0 repositories · arXiv:2110.04458
-
The Layout Generation Algorithm of Graphic Design Based on Transformer-CVAE 8 Oct 2021 · 0 repositories · arXiv:2110.06794
-
Adversarial Token Attacks on Vision Transformers 8 Oct 2021 · 0 repositories · arXiv:2110.04337
-
ALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments 8 Oct 2021 · 0 repositories · arXiv:2110.03895
-
Context-LGM: Leveraging Object-Context Relation for Context-Aware Object Recognition 8 Oct 2021 · 0 repositories · arXiv:2110.04042
-
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts 8 Oct 2021 · 0 repositories · arXiv:2110.03868
-
Development of an Extractive Title Generation System Using Titles of Papers of Top Conferences for Intermediate English Students 8 Oct 2021 · 0 repositories · arXiv:2110.04204
-
HydraSum: Disentangling Stylistic Features in Text Summarization using Multi-Decoder Models 8 Oct 2021 · 1 repository · arXiv:2110.04400Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 9 harvested samples)
-
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering 8 Oct 2021 · 0 repositories · arXiv:2110.04330
-
Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation 8 Oct 2021 · 1 repository · arXiv:2110.04000
-
Learning Adaptive Control Flow in Transformers for Improved Systematic Generalization 8 Oct 2021 · 0 repositories
-
Local and Global Context-Based Pairwise Models for Sentence Ordering 8 Oct 2021 · 1 repository · arXiv:2110.04291
-
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining 8 Oct 2021 · 0 repositories · arXiv:2110.03888
-
Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network 8 Oct 2021 · 1 repository · arXiv:2110.04002
-
RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Training 8 Oct 2021 · 1 repository · arXiv:2110.07336
-
Speeding up Deep Model Training by Sharing Weights and Then Unsharing 8 Oct 2021 · 0 repositories · arXiv:2110.03848
-
Taming Sparsely Activated Transformer with Stochastic Experts 8 Oct 2021 · 1 repository · arXiv:2110.04260Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Text analysis and deep learning: A network approach 8 Oct 2021 · 0 repositories · arXiv:2110.04151
-
Token Pooling in Vision Transformers 8 Oct 2021 · 0 repositories · arXiv:2110.03860
-
ViDT: An Efficient and Effective Fully Transformer-based Object Detector 8 Oct 2021 · 1 repository · arXiv:2110.03921
-
A Comparative Study of Transformer-Based Language Models on Extractive Question Answering 7 Oct 2021 · 0 repositories · arXiv:2110.03142
-
Attention is All You Need? Good Embeddings with Statistics are enough:Large Scale Audio Understanding without Transformers/ Convolutions/ BERTs/ Mixers/ Attention/ RNNs or .... 7 Oct 2021 · 0 repositories · arXiv:2110.03183
-
Cross-Language Learning for Entity Matching 7 Oct 2021 · 1 repository · arXiv:2110.03338
-
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models 7 Oct 2021 · 1 repository · arXiv:2110.03298Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
Generative Pre-Trained Transformer for Cardiac Abnormality Detection 7 Oct 2021 · 0 repositories · arXiv:2110.04071
-
Investigating Growth at Risk Using a Multi-country Non-parametric Quantile Factor Model 7 Oct 2021 · 0 repositories · arXiv:2110.03411
-
Layer-wise Pruning of Transformer Attention Heads for Efficient Language Modeling 7 Oct 2021 · 1 repository · arXiv:2110.03252
-
Minimum word error training for non-autoregressive Transformer-based code-switching ASR 7 Oct 2021 · 0 repositories · arXiv:2110.03573
-
Universality of Winning Tickets: A Renormalization Group Perspective 7 Oct 2021 · 0 repositories · arXiv:2110.03210
-
8-bit Optimizers via Block-wise Quantization 6 Oct 2021 · 3 repositories · arXiv:2110.02861
-
Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNs 6 Oct 2021 · 1 repository · arXiv:2110.02797
-
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy 6 Oct 2021 · 3 repositories · arXiv:2110.02642Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Dynamically Decoding Source Domain Knowledge for Domain Generalization 6 Oct 2021 · 0 repositories · arXiv:2110.03027
-
Geometric Transformers for Protein Interface Contact Prediction 6 Oct 2021 · 2 repositories · arXiv:2110.02423
-
How BPE Affects Memorization in Transformers 6 Oct 2021 · 0 repositories · arXiv:2110.02782
-
Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformer 6 Oct 2021 · 2 repositories · arXiv:2110.02544Syntology official (archive's flag): 7 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples)
-
LIDSNet: A Lightweight on-device Intent Detection model using Deep Siamese Network 6 Oct 2021 · 0 repositories · arXiv:2110.15717
-
NUS-IDS at FinCausal 2021: Dependency Tree in Graph Neural Network for Better Cause-Effect Span Detection 6 Oct 2021 · 1 repository · arXiv:2110.02991
-
On Neurons Invariant to Sentence Structural Changes in Neural Machine Translation 6 Oct 2021 · 1 repository · arXiv:2110.03067
-
PoNet: Pooling Network for Efficient Token Mixing in Long Sequences 6 Oct 2021 · 1 repository · arXiv:2110.02442Syntology official: no sample here; runs from other or unrecorded repositories · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Pretrained Transformers for Offensive Language Identification in Tanglish 6 Oct 2021 · 1 repository · arXiv:2110.02852
-
Semantic Prediction: Which One Should Come First, Recognition or Prediction? 6 Oct 2021 · 1 repository · arXiv:2110.02829