Methods › General › Attention Modules › Multi-Head Attention › Papers, page 246

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 246 of 249: papers 24,501 to 24,600 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Figure Eight at SemEval-2019 Task 3: Ensemble of Transfer Learning Methods for Contextual Emotion Detection
  1 Jun 2019 · 0 repositories
• HLT@SUDA at SemEval-2019 Task 1: UCCA Graph Parsing as Constituent Tree Parsing
  1 Jun 2019 · 0 repositories
• How Well Do Embedding Models Capture Non-compositionality? A View from Multiword Expressions
  1 Jun 2019 · 0 repositories
• Improving Cuneiform Language Identification with BERT
  1 Jun 2019 · 0 repositories
• KDEHatEval at SemEval-2019 Task 5: A Neural Network Model for Detecting Hate Speech in Twitter
  1 Jun 2019 · 0 repositories
• LAF-Net: Locally Adaptive Fusion Networks for Stereo Confidence Estimation
  1 Jun 2019 · 1 repository
• Learning RoI Transformer for Oriented Object Detection in Aerial Images
  1 Jun 2019 · 2 repositories
• LTL-UDE at SemEval-2019 Task 6: BERT and Two-Vote Classification for Categorizing Offensiveness
  1 Jun 2019 · 0 repositories
• MITRE at SemEval-2019 Task 5: Transfer Learning for Multilingual Hate Speech Detection
  1 Jun 2019 · 0 repositories
• Neural Machine Translation between Myanmar (Burmese) and Rakhine (Arakanese)
  1 Jun 2019 · 0 repositories
• NULI at SemEval-2019 Task 6: Transfer Learning for Offensive Language Detection using Bidirectional Transformers
  1 Jun 2019 · 0 repositories
• Opinion Mining with Deep Contextualized Embeddings
  1 Jun 2019 · 0 repositories
• Stance Classification, Outcome Prediction, and Impact Assessment: NLP Tasks for Studying Group Decision-Making
  1 Jun 2019 · 0 repositories
• Team Howard Beale at SemEval-2019 Task 4: Hyperpartisan News Detection with BERT
  1 Jun 2019 · 0 repositories
• Team Jack Ryder at SemEval-2019 Task 4: Using BERT Representations for Detecting Hyperpartisan News
  1 Jun 2019 · 0 repositories
• Team yeon-zi at SemEval-2019 Task 4: Hyperpartisan News Detection by De-noising Weakly-labeled Data
  1 Jun 2019 · 1 repository
• The Sally Smedley Hyperpartisan News Detector at SemEval-2019 Task 4
  1 Jun 2019 · 0 repositories
• Using Contextual Representations for Suicide Risk Assessment from Internet Forums
  1 Jun 2019 · 0 repositories
• ZQM at SemEval-2019 Task9: A Single Layer CNN Based on Pre-trained Model for Suggestion Mining
  1 Jun 2019 · 0 repositories
• Attention Is (not) All You Need for Commonsense Reasoning
  31 May 2019 · 2 repositories · arXiv:1905.13497
• MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension
  31 May 2019 · 1 repository · arXiv:1905.13453
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Sequence Modeling of Temporal Credit Assignment for Episodic Reinforcement Learning
  31 May 2019 · 1 repository · arXiv:1905.13420
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Audio Caption in a Car Setting with a Sentence-Level Loss
  31 May 2019 · 1 repository · arXiv:1905.13448
• A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehension
  30 May 2019 · 0 repositories · arXiv:1905.12848
• Hierarchical Transformers for Multi-Document Summarization
  30 May 2019 · 1 repository · arXiv:1905.13164
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 2 pointer-only (licence)
• Unbabel's Submission to the WMT2019 APE Shared Task: BERT-based Encoder-Decoder for Automatic Post-Editing
  30 May 2019 · 0 repositories · arXiv:1905.13068
• A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models
  29 May 2019 · 1 repository · arXiv:1905.12790
  Syntology official (archive's flag): 2 ran · 3 ran (of which 2 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Path-Augmented Graph Transformer Network
  29 May 2019 · 2 repositories · arXiv:1905.12712
  Syntology official (archive's flag): 6 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
• Towards better substitution-based word sense induction
  29 May 2019 · 2 repositories · arXiv:1905.12598
• Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)
  28 May 2019 · 1 repository · arXiv:1905.11833
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Combating Adversarial Misspellings with Robust Word Recognition
  27 May 2019 · 3 repositories · arXiv:1905.11268
• Compositional pre-training for neural semantic parsing
  27 May 2019 · 0 repositories · arXiv:1905.11531
• Levenshtein Transformer
  27 May 2019 · 3 repositories · arXiv:1905.11006
• Hashing based Answer Selection
  26 May 2019 · 0 repositories · arXiv:1905.10718
• Are Sixteen Heads Really Better than One?
  25 May 2019 · 4 repositories · arXiv:1905.10650
• Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers
  25 May 2019 · 3 repositories · arXiv:1905.10630
• A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translation
  24 May 2019 · 0 repositories · arXiv:1905.10453
• BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
  24 May 2019 · 1 repository · arXiv:1905.10044
• Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark
  24 May 2019 · 0 repositories · arXiv:1905.10425
• SCRAM: Spatially Coherent Randomized Attention Maps
  24 May 2019 · 0 repositories · arXiv:1905.10308
• Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned
  23 May 2019 · 1 repository · arXiv:1905.09418
• Deeper Text Understanding for IR with Contextual Neural Language Modeling
  22 May 2019 · 1 repository · arXiv:1905.09217
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 2 pointer-only (licence)
• FastSpeech: Fast, Robust and Controllable Text to Speech
  22 May 2019 · 22 repositories · arXiv:1905.09263
  Syntology 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• FastSpeech: Fast,Robustand Controllable Text-to-Speech
  22 May 2019 · 11 repositories
• A Seq-to-Seq Transformer Premised Temporal Convolutional Network for Chinese Word Segmentation
  21 May 2019 · 0 repositories · arXiv:1905.08454
• Generating Logical Forms from Graph Representations of Text and Entities
  21 May 2019 · 0 repositories · arXiv:1905.08407
• Lightweight Network Architecture for Real-Time Action Recognition
  21 May 2019 · 1 repository · arXiv:1905.08711
• Look Again at the Syntax: Relational Graph Convolutional Network for Gendered Ambiguous Pronoun Resolution
  21 May 2019 · 1 repository · arXiv:1905.08868
• Sample Efficient Text Summarization Using a Single Pre-Trained Transformer
  21 May 2019 · 2 repositories · arXiv:1905.08836
• Enriching Pre-trained Language Model with Entity Information for Relation Classification
  20 May 2019 · 6 repositories · arXiv:1905.08284
  Syntology 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
• Multimodal Transformer with Multi-View Visual Representation for Image Captioning
  20 May 2019 · 0 repositories · arXiv:1905.07841
• Adaptive Attention Span in Transformers
  19 May 2019 · 8 repositories · arXiv:1905.07799
• HellaSwag: Can a Machine Really Finish Your Sentence?
  19 May 2019 · 2 repositories · arXiv:1905.07830
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)
• BERTSel: Answer Selection with Pre-trained Models
  18 May 2019 · 1 repository · arXiv:1905.07588
• ERNIE: Enhanced Language Representation with Informative Entities
  17 May 2019 · 2 repositories · arXiv:1905.07129
  Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Story Ending Prediction by Transferable BERT
  17 May 2019 · 1 repository · arXiv:1905.07504
• Joint Source-Target Self Attention with Locality Constraints
  16 May 2019 · 2 repositories · arXiv:1905.06596
• HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization
  16 May 2019 · 0 repositories · arXiv:1905.06566
• Latent Universal Task-Specific BERT
  16 May 2019 · 0 repositories · arXiv:1905.06638
• A Surprisingly Robust Trick for Winograd Schema Challenge
  15 May 2019 · 2 repositories · arXiv:1905.06290
• Behavior Sequence Transformer for E-commerce Recommendation in Alibaba
  15 May 2019 · 9 repositories · arXiv:1905.06874
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• BERT Rediscovers the Classical NLP Pipeline
  15 May 2019 · 1 repository · arXiv:1905.05950
• Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation
  14 May 2019 · 4 repositories · arXiv:1905.05621
  Syntology community repositories only · 3 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT Model
  14 May 2019 · 1 repository · arXiv:1906.02124
• BERT with History Answer Embedding for Conversational Question Answering
  14 May 2019 · 1 repository · arXiv:1905.05412
• Cognitive Graph for Multi-Hop Reading Comprehension at Scale
  14 May 2019 · 2 repositories · arXiv:1905.05460
  Syntology official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 2 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 1 pointer-only (licence)
• How to Fine-Tune BERT for Text Classification?
  14 May 2019 · 15 repositories · arXiv:1905.05583
  Syntology official (archive's flag): 1 ran · 12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 18 harvested samples) · 5 pointer-only (licence)
• Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation
  14 May 2019 · 2 repositories · arXiv:1905.05677
• Almost Unsupervised Text to Speech and Automatic Speech Recognition
  13 May 2019 · 0 repositories · arXiv:1905.06791
• Synchronous Bidirectional Neural Machine Translation
  13 May 2019 · 2 repositories · arXiv:1905.04847
• Weakly-supervised Caricature Face Parsing through Domain Adaptation
  13 May 2019 · 1 repository · arXiv:1905.05091
• Densifying Assumed-sparse Tensors: Improving Memory Efficiency and MPI Collective Performance during Tensor Accumulation for Parallelized Training of Neural Machine Translation Models
  10 May 2019 · 0 repositories · arXiv:1905.04035
• Language Modeling with Deep Transformers
  10 May 2019 · 0 repositories · arXiv:1905.04226
• A logical-based corpus for cross-lingual evaluation
  10 May 2019 · 1 repository · arXiv:1905.05704
• AutoAssist: A Framework to Accelerate Training of Deep Neural Networks
  8 May 2019 · 1 repository · arXiv:1905.03381
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance
  8 May 2019 · 1 repository · arXiv:1905.02851
• Photometric Transformer Networks and Label Adjustment for Breast Density Prediction
  8 May 2019 · 0 repositories · arXiv:1905.02906
• RWTH ASR Systems for LibriSpeech: Hybrid vs Attention -- w/o Data Augmentation
  8 May 2019 · 2 repositories · arXiv:1905.03072
• Unified Language Model Pre-training for Natural Language Understanding and Generation
  8 May 2019 · 9 repositories · arXiv:1905.03197
• Taming Pretrained Transformers for Extreme Multi-label Text Classification
  7 May 2019 · 2 repositories · arXiv:1905.02331
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• MASS: Masked Sequence to Sequence Pre-training for Language Generation
  7 May 2019 · 7 repositories · arXiv:1905.02450
• Anonymized BERT: An Augmentation Approach to the Gendered Pronoun Resolution Challenge
  6 May 2019 · 1 repository · arXiv:1905.01780
• POG: Personalized Outfit Generation for Fashion Recommendation at Alibaba iFashion
  6 May 2019 · 1 repository · arXiv:1905.01866
• Investigating the Successes and Failures of BERT for Passage Re-Ranking
  5 May 2019 · 0 repositories · arXiv:1905.01758
• Discourse Representation Structure Parsing with Recurrent Neural Networks and the Transformer Model
  1 May 2019 · 0 repositories
• Graph Transformer
  1 May 2019 · 0 repositories
• Multi-Agent Dual Learning
  1 May 2019 · 0 repositories
• Robustness and Equivariance of Neural Networks
  1 May 2019 · 0 repositories
• Total Style Transfer with a Single Feed-Forward Network
  1 May 2019 · 0 repositories
• Towards a better understanding of Vector Quantized Autoencoders
  1 May 2019 · 0 repositories
• Transformer-XL: Language Modeling with Longer-Term Dependency
  1 May 2019 · 0 repositories
• Very Deep Self-Attention Networks for End-to-End Speech Recognition
  30 Apr 2019 · 0 repositories · arXiv:1904.13377
• Unsupervised Data Augmentation for Consistency Training
  29 Apr 2019 · 20 repositories · arXiv:1904.12848
  Syntology official (archive's flag): 10 ran · 30 ran (of which 3 constructed an object rather than computing a result; 22 with no instrument failure: 0 honoured, 0 violated, 22 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified (of 52 harvested samples) · 17 pointer-only (licence)
• Softmax Optimizations for Intel Xeon Processor-based Platforms
  28 Apr 2019 · 0 repositories · arXiv:1904.12380
• Transformers with convolutional context for ASR
  26 Apr 2019 · 4 repositories · arXiv:1904.11660
  Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• Low-Memory Neural Network Training: A Technical Report
  24 Apr 2019 · 0 repositories · arXiv:1904.10631
• Generating Long Sequences with Sparse Transformers
  23 Apr 2019 · 7 repositories · arXiv:1904.10509
  Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
• Attention Augmented Convolutional Networks
  22 Apr 2019 · 14 repositories · arXiv:1904.09925
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
• Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
  22 Apr 2019 · 7 repositories · arXiv:1905.01969
• Dynamic Past and Future for Neural Machine Translation
  21 Apr 2019 · 1 repository · arXiv:1904.09646