Methods › General › Attention Modules › Multi-Head Attention › Papers, page 223
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 223 of 249: papers 22,201 to 22,300 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
The NU Voice Conversion System for the Voice Conversion Challenge 2020: On the Effectiveness of Sequence-to-sequence Models and Autoregressive Neural Vocoders 9 Oct 2020 · 0 repositories · arXiv:2010.04446
-
Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis 9 Oct 2020 · 1 repository · arXiv:2010.04543
-
What Have We Achieved on Text Summarization? 9 Oct 2020 · 1 repository · arXiv:2010.04529
-
A Co-Interactive Transformer for Joint Slot Filling and Intent Detection 8 Oct 2020 · 1 repository · arXiv:2010.03880
-
Automatic generation of reviews of scientific papers 8 Oct 2020 · 1 repository · arXiv:2010.04147
-
Deep Learning Meets Projective Clustering 8 Oct 2020 · 0 repositories · arXiv:2010.04290
-
Deformable DETR: Deformable Transformers for End-to-End Object Detection 8 Oct 2020 · 20 repositories · arXiv:2010.04159Syntology community repositories only · 37 ran (of which 9 constructed an object rather than computing a result; 24 with no instrument failure: 1 honoured, 3 violated, 20 with no contract checked; 13 where Syntology's instrument failed) · 18 unverified (of 55 harvested samples) · 21 pointer-only (licence)
-
Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference 8 Oct 2020 · 1 repository · arXiv:2010.03760
-
Improving Attention Mechanism with Query-Value Interaction 8 Oct 2020 · 0 repositories · arXiv:2010.03766
-
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition 8 Oct 2020 · 1 repository · arXiv:2010.03746
-
Injecting Word Information with Multi-Level Word Adapter for Chinese Spoken Language Understanding 8 Oct 2020 · 1 repository · arXiv:2010.03903
-
Interlocking Backpropagation: Improving depthwise model-parallelism 8 Oct 2020 · 1 repository · arXiv:2010.04116
-
Leveraging Unpaired Text Data for Training End-to-End Speech-to-Intent Systems 8 Oct 2020 · 0 repositories · arXiv:2010.04284
-
Masked ELMo: An evolution of ELMo towards fully contextual RNN language models 8 Oct 2020 · 0 repositories · arXiv:2010.04302
-
PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge 8 Oct 2020 · 1 repository · arXiv:2010.03725
-
Shallow-to-Deep Training for Neural Machine Translation 8 Oct 2020 · 1 repository · arXiv:2010.03737
-
TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling 8 Oct 2020 · 1 repository · arXiv:2010.03802
-
Visual News: Benchmark and Challenges in News Image Captioning 8 Oct 2020 · 1 repository · arXiv:2010.03743
-
Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets 7 Oct 2020 · 0 repositories · arXiv:2010.03614
-
Detecting Fine-Grained Cross-Lingual Semantic Divergences without Supervision by Learning to Rank 7 Oct 2020 · 1 repository · arXiv:2010.03662
-
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling 7 Oct 2020 · 0 repositories · arXiv:2010.03099
-
ELMo and BERT in semantic change detection for Russian 7 Oct 2020 · 0 repositories · arXiv:2010.03481
-
Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing 7 Oct 2020 · 1 repository · arXiv:2010.03546
-
AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models 7 Oct 2020 · 1 repository · arXiv:2010.03688
-
Super-Human Performance in Online Low-latency Recognition of Conversational Speech 7 Oct 2020 · 1 repository · arXiv:2010.03449
-
Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields 7 Oct 2020 · 1 repository · arXiv:2010.03224
-
Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News 7 Oct 2020 · 2 repositories · arXiv:2010.03159Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Why do you think that? Exploring Faithful Sentence-Level Rationales Without Supervision 7 Oct 2020 · 1 repository · arXiv:2010.03384
-
Adversarial Grammatical Error Correction 6 Oct 2020 · 0 repositories · arXiv:2010.02407
-
Analyzing Individual Neurons in Pre-trained Language Models 6 Oct 2020 · 1 repository · arXiv:2010.02695
-
BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised Representations 6 Oct 2020 · 1 repository · arXiv:2010.02686
-
Beyond [CLS] through Ranking by Generation 6 Oct 2020 · 0 repositories · arXiv:2010.03073
-
Converting the Point of View of Messages Spoken to Virtual Assistants 6 Oct 2020 · 2 repositories · arXiv:2010.02600
-
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher 6 Oct 2020 · 1 repository · arXiv:2010.02562
-
Do Explicit Alignments Robustly Improve Multilingual Encoders? 6 Oct 2020 · 1 repository · arXiv:2010.02537
-
Efficient Inference For Neural Machine Translation 6 Oct 2020 · 0 repositories · arXiv:2010.02416
-
Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming 6 Oct 2020 · 1 repository · arXiv:2010.03010Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation 6 Oct 2020 · 1 repository · arXiv:2010.02666
-
Incorporating Behavioral Hypotheses for Query Generation 6 Oct 2020 · 0 repositories · arXiv:2010.02667
-
Intrinsic Probing through Dimension Selection 6 Oct 2020 · 1 repository · arXiv:2010.02812Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Investigating African-American Vernacular English in Transformer-Based Text Generation 6 Oct 2020 · 1 repository · arXiv:2010.02510
-
LEGAL-BERT: The Muppets straight out of Law School 6 Oct 2020 · 0 repositories · arXiv:2010.02559
-
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation 6 Oct 2020 · 1 repository · arXiv:2010.02705
-
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers 6 Oct 2020 · 0 repositories · arXiv:2010.02616
-
On the Sub-Layer Functionalities of Transformer Decoder 6 Oct 2020 · 0 repositories · arXiv:2010.02648
-
Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder 6 Oct 2020 · 2 repositories · arXiv:2010.02684Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Pretrained Language Model Embryology: The Birth of ALBERT 6 Oct 2020 · 1 repository · arXiv:2010.02480
-
Resource-Enhanced Neural Model for Event Argument Extraction 6 Oct 2020 · 0 repositories · arXiv:2010.03022
-
Scene Graph Modification Based on Natural Language Commands 6 Oct 2020 · 1 repository · arXiv:2010.02591
-
The Multilingual Amazon Reviews Corpus 6 Oct 2020 · 1 repository · arXiv:2010.02573
-
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications 6 Oct 2020 · 0 repositories · arXiv:2010.08412
-
GenAug: Data Augmentation for Finetuning Text Generators 5 Oct 2020 · 2 repositories · arXiv:2010.01794
-
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? 5 Oct 2020 · 0 repositories · arXiv:2010.01764
-
Improving AMR Parsing with Sequence-to-Sequence Pre-training 5 Oct 2020 · 1 repository · arXiv:2010.01771
-
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective 5 Oct 2020 · 2 repositories · arXiv:2010.02329Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Linguistic Profiling of a Neural Language Model 5 Oct 2020 · 0 repositories · arXiv:2010.01869
-
Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks 5 Oct 2020 · 0 repositories · arXiv:2010.02394
-
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation 5 Oct 2020 · 0 repositories · arXiv:2010.02301
-
Pareto Probing: Trading Off Accuracy for Complexity 5 Oct 2020 · 1 repository · arXiv:2010.02180Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
PMI-Masking: Principled masking of correlated spans 5 Oct 2020 · 1 repository · arXiv:2010.01825
-
Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior 5 Oct 2020 · 1 repository · arXiv:2010.01791
-
PUM at SemEval-2020 Task 12: Aggregation of Transformer-based models' features for offensive language recognition 5 Oct 2020 · 0 repositories · arXiv:2010.01897
-
Self-training Improves Pre-training for Natural Language Understanding 5 Oct 2020 · 1 repository · arXiv:2010.02194
-
Transformer-Based Neural Text Generation with Syntactic Guidance 5 Oct 2020 · 1 repository · arXiv:2010.01737
-
Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning 5 Oct 2020 · 1 repository · arXiv:2010.01781
-
X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset 5 Oct 2020 · 1 repository · arXiv:2010.01998
-
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels 4 Oct 2020 · 1 repository · arXiv:2010.01653Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Inquisitive Question Generation for High Level Text Comprehension 4 Oct 2020 · 1 repository · arXiv:2010.01657
-
On Losses for Modern Language Models 4 Oct 2020 · 1 repository · arXiv:2010.01694
-
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space 4 Oct 2020 · 1 repository · arXiv:2010.01475
-
Mining Knowledge for Natural Language Inference from Wikipedia Categories 3 Oct 2020 · 1 repository · arXiv:2010.01239Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles 3 Oct 2020 · 0 repositories · arXiv:2010.01309
-
Beyond Chemical 1D knowledge using Transformers 2 Oct 2020 · 0 repositories · arXiv:2010.01027
-
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media 2 Oct 2020 · 0 repositories · arXiv:2010.01150
-
Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesis 2 Oct 2020 · 0 repositories · arXiv:2010.00792
-
Data-Efficient Pretraining via Contrastive Self-Supervision 2 Oct 2020 · 0 repositories · arXiv:2010.01061
-
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention 2 Oct 2020 · 9 repositories · arXiv:2010.01057Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 10 harvested samples)
-
MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale 2 Oct 2020 · 1 repository · arXiv:2010.00980
-
STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++ 2 Oct 2020 · 1 repository · arXiv:2010.00760
-
A Compare Aggregate Transformer for Understanding Document-grounded Dialogue 1 Oct 2020 · 0 repositories · arXiv:2010.00190
-
A Technical Question Answering System with Transfer Learning 1 Oct 2020 · 1 repository
-
Beyond The Text: Analysis of Privacy Statements through Syntactic and Semantic Role Labeling 1 Oct 2020 · 0 repositories · arXiv:2010.00678
-
CoLAKE: Contextualized Language and Knowledge Embedding 1 Oct 2020 · 1 repository · arXiv:2010.00309Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERT 1 Oct 2020 · 0 repositories · arXiv:2010.00357
-
Evaluating Multilingual BERT for Estonian 1 Oct 2020 · 0 repositories · arXiv:2010.00454
-
Examining the rhetorical capacities of neural language models 1 Oct 2020 · 0 repositories · arXiv:2010.00153
-
Phonemer at WNUT-2020 Task 2: Sequence Classification Using COVID Twitter BERT and Bagging Ensemble Technique based on Plurality Voting 1 Oct 2020 · 1 repository · arXiv:2010.00294
-
RefVOS: A Closer Look at Referring Expressions for Video Object Segmentation 1 Oct 2020 · 2 repositories · arXiv:2010.00263
-
RRF102: Meeting the TREC-COVID Challenge with a 100+ Runs Ensemble 1 Oct 2020 · 0 repositories · arXiv:2010.00200
-
Transformers: State-of-the-Art Natural Language Processing 1 Oct 2020 · 3 repositories
-
Understanding tables with intermediate pre-training 1 Oct 2020 · 1 repository · arXiv:2010.00571
-
WeChat Neural Machine Translation Systems for WMT20 1 Oct 2020 · 0 repositories · arXiv:2010.00247
-
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing 30 Sep 2020 · 1 repository · arXiv:2009.14809
-
A Vietnamese Dataset for Evaluating Machine Reading Comprehension 30 Sep 2020 · 0 repositories · arXiv:2009.14725
-
AUBER: Automated BERT Regularization 30 Sep 2020 · 0 repositories · arXiv:2009.14409
-
BERT for Monolingual and Cross-Lingual Reverse Dictionary 30 Sep 2020 · 1 repository · arXiv:2009.14790
-
Interpretable Machine Learning for COVID-19: An Empirical Study on Severity Prediction Task 30 Sep 2020 · 1 repository · arXiv:2010.02006
-
Learning Hard Retrieval Decoder Attention for Transformers 30 Sep 2020 · 0 repositories · arXiv:2009.14658
-
Measuring Systematic Generalization in Neural Proof Generation with Transformers 30 Sep 2020 · 2 repositories · arXiv:2009.14786Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
MQTransformer: Multi-Horizon Forecasts with Context Dependent and Feedback-Aware Attention 30 Sep 2020 · 0 repositories · arXiv:2009.14799