Methods › General › Attention Modules › Multi-Head Attention › Papers, page 204
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 204 of 249: papers 20,301 to 20,400 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Fully Transformer Networks for Semantic Image Segmentation 8 Jun 2021 · 1 repository · arXiv:2106.04108
-
Hash Layers For Large Sparse Models 8 Jun 2021 · 0 repositories · arXiv:2106.04426
-
MVT: Mask Vision Transformer for Facial Expression Recognition in the wild 8 Jun 2021 · 0 repositories · arXiv:2106.04520
-
On the Lack of Robust Interpretability of Neural Text Classifiers 8 Jun 2021 · 0 repositories · arXiv:2106.04631
-
Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation 8 Jun 2021 · 1 repository · arXiv:2106.04447
-
Scaling Vision Transformers 8 Jun 2021 · 1 repository · arXiv:2106.04560
-
Speech BERT Embedding For Improving Prosody in Neural TTS 8 Jun 2021 · 0 repositories · arXiv:2106.04312
-
Staircase Attention for Recurrent Processing of Sequences 8 Jun 2021 · 1 repository · arXiv:2106.04279
-
TIMEDIAL: Temporal Commonsense Reasoning in Dialog 8 Jun 2021 · 1 repository · arXiv:2106.04571
-
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model 8 Jun 2021 · 1 repository · arXiv:2106.04098
-
Attention Temperature Matters in Abstractive Summarization Distillation 7 Jun 2021 · 1 repository · arXiv:2106.03441
-
BERTGEN: Multi-task Generation through BERT 7 Jun 2021 · 1 repository · arXiv:2106.03484
-
LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models 7 Jun 2021 · 0 repositories · arXiv:2106.03379
-
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning 7 Jun 2021 · 0 repositories · arXiv:2106.03921
-
Neural Abstractive Unsupervised Summarization of Online News Discussions 7 Jun 2021 · 1 repository · arXiv:2106.03953
-
Never guess what I heard... Rumor Detection in Finnish News: a Dataset and a Baseline 7 Jun 2021 · 0 repositories · arXiv:2106.03389
-
Person Re-Identification with a Locally Aware Transformer 7 Jun 2021 · 1 repository · arXiv:2106.03720Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Progressive Open-Domain Response Generation with Multiple Controllable Attributes 7 Jun 2021 · 0 repositories · arXiv:2106.14614
-
Rethinking Graph Transformers with Spectral Attention 7 Jun 2021 · 1 repository · arXiv:2106.03893
-
Reveal of Vision Transformers Robustness against Adversarial Attacks 7 Jun 2021 · 0 repositories · arXiv:2106.03734
-
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer 7 Jun 2021 · 4 repositories · arXiv:2106.03650Syntology 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 6 pointer-only (licence)
-
Visual Transformer for Task-aware Active Learning 7 Jun 2021 · 1 repository · arXiv:2106.03801
-
ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias 7 Jun 2021 · 2 repositories · arXiv:2106.03348Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Attend and select: A segment selective transformer for microblog hashtag generation 6 Jun 2021 · 1 repository · arXiv:2106.03151
-
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings 6 Jun 2021 · 1 repository · arXiv:2106.03143
-
Causal Abstractions of Neural Networks 6 Jun 2021 · 1 repository · arXiv:2106.02997
-
Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ 6 Jun 2021 · 0 repositories · arXiv:2106.03009
-
Oriented Object Detection with Transformer 6 Jun 2021 · 0 repositories · arXiv:2106.03146
-
Rethinking Training from Scratch for Object Detection 6 Jun 2021 · 1 repository · arXiv:2106.03112
-
Vision Transformers with Hierarchical Attention 6 Jun 2021 · 3 repositories · arXiv:2106.03180
-
Transient Chaos in BERT 6 Jun 2021 · 0 repositories · arXiv:2106.03181
-
Uformer: A General U-Shaped Transformer for Image Restoration 6 Jun 2021 · 4 repositories · arXiv:2106.03106Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
BERTnesia: Investigating the capture and forgetting of knowledge in BERT 5 Jun 2021 · 1 repository · arXiv:2106.02902
-
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding 5 Jun 2021 · 1 repository · arXiv:2106.02795Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Associating Objects with Transformers for Video Object Segmentation 4 Jun 2021 · 2 repositories · arXiv:2106.02638
-
BERT-Based Sentiment Analysis: A Software Engineering Perspective 4 Jun 2021 · 2 repositories · arXiv:2106.02581
-
COLD: Concurrent Loads Disaggregator for Non-Intrusive Load Monitoring 4 Jun 2021 · 1 repository · arXiv:2106.02352
-
Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL 4 Jun 2021 · 1 repository · arXiv:2106.02193Syntology official (archive's flag): 7 ran · 7 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing 4 Jun 2021 · 0 repositories · arXiv:2106.02559
-
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression 4 Jun 2021 · 1 repository · arXiv:2106.02241
-
Few-Shot Segmentation via Cycle-Consistent Transformer 4 Jun 2021 · 2 repositories · arXiv:2106.02320Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Glance-and-Gaze Vision Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02277
-
Scalable Transformers for Neural Machine Translation 4 Jun 2021 · 0 repositories · arXiv:2106.02242
-
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning 4 Jun 2021 · 3 repositories · arXiv:2106.02584Syntology official (archive's flag): 6 ran · 22 ran (of which 4 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 1 violated, 19 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 30 harvested samples)
-
The Image Local Autoregressive Transformer 4 Jun 2021 · 1 repository · arXiv:2106.02514
-
Towards Equal Gender Representation in the Annotations of Toxic Language Detection 4 Jun 2021 · 0 repositories · arXiv:2106.02183
-
You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient 4 Jun 2021 · 1 repository · arXiv:2106.02435
-
A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer 3 Jun 2021 · 0 repositories · arXiv:2106.01927
-
An Improved Model for Voicing Silent Speech 3 Jun 2021 · 1 repository · arXiv:2106.01933
-
Anticipative Video Transformer 3 Jun 2021 · 1 repository · arXiv:2106.02036Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Auto-tagging of Short Conversational Sentences using Transformer Methods 3 Jun 2021 · 0 repositories · arXiv:2106.01735
-
BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions 3 Jun 2021 · 0 repositories · arXiv:2106.01536
-
Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA? 3 Jun 2021 · 1 repository · arXiv:2106.01561Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
CCPM: A Chinese Classical Poetry Matching Dataset 3 Jun 2021 · 1 repository · arXiv:2106.01979
-
Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation 3 Jun 2021 · 0 repositories · arXiv:2106.02607
-
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning 3 Jun 2021 · 0 repositories · arXiv:2106.01804
-
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech 3 Jun 2021 · 1 repository · arXiv:2106.01625Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? 3 Jun 2021 · 0 repositories · arXiv:2106.02171
-
ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematics 3 Jun 2021 · 1 repository · arXiv:2106.01981
-
Offline Reinforcement Learning as One Big Sequence Modeling Problem 3 Jun 2021 · 2 repositories · arXiv:2106.02039Syntology official (archive's flag): 16 ran · 23 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 0 violated, 21 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 28 harvested samples) · 1 pointer-only (licence)
-
Self-Guided Contrastive Learning for BERT Sentence Representations 3 Jun 2021 · 1 repository · arXiv:2106.07345Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization 3 Jun 2021 · 2 repositories · arXiv:2106.01890Syntology official (archive's flag): 1 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction 3 Jun 2021 · 1 repository · arXiv:2106.01609
-
Template-Based Named Entity Recognition Using BART 3 Jun 2021 · 1 repository · arXiv:2106.01760
-
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models 3 Jun 2021 · 3 repositories · arXiv:2106.01950Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
The Limitations of Limited Context for Constituency Parsing 3 Jun 2021 · 0 repositories · arXiv:2106.01580
-
"You made me feel this way": Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data 3 Jun 2021 · 0 repositories · arXiv:2106.01526
-
belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification 2 Jun 2021 · 0 repositories · arXiv:2106.01091
-
Container: Context Aggregation Network 2 Jun 2021 · 4 repositories · arXiv:2106.01401Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Decision Transformer: Reinforcement Learning via Sequence Modeling 2 Jun 2021 · 20 repositories · arXiv:2106.01345Syntology community repositories only · 17 ran (of which 10 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 9 unverified (of 26 harvested samples) · 8 pointer-only (licence)
-
Differential Privacy for Text Analytics via Natural Text Sanitization 2 Jun 2021 · 1 repository · arXiv:2106.01221Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization 2 Jun 2021 · 1 repository · arXiv:2106.01317Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Evaluating the Efficacy of Summarization Evaluation across Languages 2 Jun 2021 · 1 repository · arXiv:2106.01478
-
Evidence-based Factual Error Correction 2 Jun 2021 · 1 repository · arXiv:2106.01072
-
Generating Informative Conclusions for Argumentative Texts 2 Jun 2021 · 1 repository · arXiv:2106.01064
-
Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling 2 Jun 2021 · 0 repositories · arXiv:2106.01040
-
IrEne: Interpretable Energy Prediction for Transformers 2 Jun 2021 · 1 repository · arXiv:2106.01199Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Lightweight Adapter Tuning for Multilingual Speech Translation 2 Jun 2021 · 2 repositories · arXiv:2106.01463
-
MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education 2 Jun 2021 · 1 repository · arXiv:2106.07340Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers 2 Jun 2021 · 0 repositories · arXiv:2106.01335
-
Self-Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference 2 Jun 2021 · 1 repository · arXiv:2106.01186
-
Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text 2 Jun 2021 · 0 repositories · arXiv:2106.00893
-
SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics 2 Jun 2021 · 1 repository · arXiv:2106.01077
-
T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT 2 Jun 2021 · 0 repositories · arXiv:2106.01097
-
Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection 2 Jun 2021 · 0 repositories · arXiv:2106.01071
-
Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machines 2 Jun 2021 · 0 repositories · arXiv:2106.01506
-
TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification 2 Jun 2021 · 3 repositories · arXiv:2106.00908
-
Ad Headline Generation using Self-Critical Masked Language Model 1 Jun 2021 · 0 repositories
-
An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models 1 Jun 2021 · 0 repositories
-
Comparing Test Sets with Item Response Theory 1 Jun 2021 · 0 repositories · arXiv:2106.00840
-
Contextual Domain Classification with Temporal Representations 1 Jun 2021 · 0 repositories
-
Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis 1 Jun 2021 · 0 repositories
-
Cooperative Multi-Agent Transfer Learning with Level-Adaptive Credit Assignment 1 Jun 2021 · 0 repositories · arXiv:2106.00517
-
Cost-effective Deployment of BERT Models in Serverless Environment 1 Jun 2021 · 0 repositories
-
Cultural and Geographical Influences on Image Translatability of Words across Languages 1 Jun 2021 · 1 repository
-
Domain Adaptation for Arabic Cross-Domain and Cross-Dialect Sentiment Analysis from Contextualized Word Embedding 1 Jun 2021 · 1 repository
-
DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference 1 Jun 2021 · 0 repositories
-
Dual-Objective Fine-Tuning of BERT for Entity Matching 1 Jun 2021 · 1 repository
-
Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters 1 Jun 2021 · 1 repository
-
Emotion-Infused Models for Explainable Psychological Stress Detection 1 Jun 2021 · 1 repository