Methods › General › Attention Modules › Multi-Head Attention › Papers, page 247

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 247 of 249: papers 24,601 to 24,700 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System
  21 Apr 2019 · 0 repositories · arXiv:1904.09636
• Repurposing Entailment for Multi-Hop Question Answering Tasks
  20 Apr 2019 · 4 repositories · arXiv:1904.09380
• Language Models with Transformers
  20 Apr 2019 · 1 repository · arXiv:1904.09408
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Mask-Predict: Parallel Decoding of Conditional Masked Language Models
  19 Apr 2019 · 2 repositories · arXiv:1904.09324
  Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• An Evaluation of Transfer Learning for Classifying Sales Engagement Emails at Large Scale
  19 Apr 2019 · 0 repositories · arXiv:1905.01971
• Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
  19 Apr 2019 · 2 repositories · arXiv:1904.09077
• ERNIE: Enhanced Representation through Knowledge Integration
  19 Apr 2019 · 19 repositories · arXiv:1904.09223
  Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• Unifying Question Answering, Text Classification, and Regression via Span Extraction
  19 Apr 2019 · 0 repositories · arXiv:1904.09286
• Real-Time Style Transfer With Strength Control
  18 Apr 2019 · 1 repository · arXiv:1904.08643
• DocBERT: BERT for Document Classification
  17 Apr 2019 · 3 repositories · arXiv:1904.08398
  Syntology official (archive's flag): 6 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples)
• Understanding the Behaviors of BERT in Ranking
  16 Apr 2019 · 0 repositories · arXiv:1904.07531
• CEDR: Contextualized Embeddings for Document Ranking
  15 Apr 2019 · 7 repositories · arXiv:1904.07094
  Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)
• Improving Human Text Comprehension through Semi-Markov CRF-based Neural Section Title Generation
  15 Apr 2019 · 0 repositories · arXiv:1904.07142
• Personalized Re-ranking for Recommendation
  15 Apr 2019 · 1 repository · arXiv:1904.06813
• Pre-training of Context-aware Item Representation for Next Basket Recommendation
  14 Apr 2019 · 0 repositories · arXiv:1904.12604
• Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering
  14 Apr 2019 · 0 repositories · arXiv:1904.06652
• Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking
  14 Apr 2019 · 2 repositories · arXiv:1904.06707
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• An Empirical Study of Spatial Attention Mechanisms in Deep Networks
  11 Apr 2019 · 1 repository · arXiv:1904.05873
• Harvey Mudd College at SemEval-2019 Task 4: The Clint Buchanan Hyperpartisan News Detector
  10 Apr 2019 · 1 repository · arXiv:1905.01962
• NLPR@SRPOL at SemEval-2019 Task 6 and Task 5: Linguistically enhanced deep learning offensive sentence classifier
  10 Apr 2019 · 0 repositories · arXiv:1904.05152
• Simple BERT Models for Relation Extraction and Semantic Role Labeling
  10 Apr 2019 · 3 repositories · arXiv:1904.05255
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing
  9 Apr 2019 · 1 repository · arXiv:1904.04697
• Attention-based Multi-instance Neural Network for Medical Diagnosis from Incomplete and Low Quality Data
  9 Apr 2019 · 1 repository · arXiv:1904.04460
• Jointly Measuring Diversity and Quality in Text Generation Models
  8 Apr 2019 · 3 repositories · arXiv:1904.03971
  Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
• Identity-preserving Face Recovery from Stylized Portraits
  7 Apr 2019 · 0 repositories · arXiv:1904.04241
• Modeling Point Clouds with Self-Attention and Gumbel Subset Sampling
  6 Apr 2019 · 0 repositories · arXiv:1904.03375
• Publicly Available Clinical BERT Embeddings
  6 Apr 2019 · 3 repositories · arXiv:1904.03323
  Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• ThisIsCompetition at SemEval-2019 Task 9: BERT is unstable for out-of-domain samples
  6 Apr 2019 · 0 repositories · arXiv:1904.03339
• Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion
  6 Apr 2019 · 0 repositories · arXiv:1904.03446
• UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs
  6 Apr 2019 · 1 repository · arXiv:1904.03450
• Convolutional Self-Attention Networks
  5 Apr 2019 · 0 repositories · arXiv:1904.03107
• Information Aggregation for Multi-Head Attention with Routing-by-Agreement
  5 Apr 2019 · 0 repositories · arXiv:1904.03100
• Modeling Recurrence for Transformer
  5 Apr 2019 · 0 repositories · arXiv:1904.03092
• Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
  4 Apr 2019 · 1 repository · arXiv:1904.02817
• Visualizing Attention in Transformer-Based Language Representation Models
  4 Apr 2019 · 0 repositories · arXiv:1904.02679
• 75 Languages, 1 Model: Parsing Universal Dependencies Universally
  3 Apr 2019 · 3 repositories · arXiv:1904.02099
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples)
• BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
  3 Apr 2019 · 1 repository · arXiv:1904.02232
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Probing Biomedical Embeddings from Language Models
  3 Apr 2019 · 1 repository · arXiv:1904.02181
• VideoBERT: A Joint Model for Video and Language Representation Learning
  3 Apr 2019 · 3 repositories · arXiv:1904.01766
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
  1 Apr 2019 · 32 repositories · arXiv:1904.00962
  Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 9 pointer-only (licence)
• Regional Homogeneity: Towards Learning Transferable Universal Adversarial Perturbations Against Defenses
  1 Apr 2019 · 1 repository · arXiv:1904.00979
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• ANA at SemEval-2019 Task 3: Contextual Emotion detection in Conversations through hierarchical LSTMs and BERT
  30 Mar 2019 · 1 repository · arXiv:1904.00132
• Making Neural Machine Reading Comprehension Faster
  29 Mar 2019 · 0 repositories · arXiv:1904.00796
• Towards Knowledge-Based Personalized Product Description Generation in E-commerce
  29 Mar 2019 · 4 repositories · arXiv:1903.12457
• Distilling Task-Specific Knowledge from BERT into Simple Neural Networks
  28 Mar 2019 · 4 repositories · arXiv:1903.12136
  Syntology 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
• Train, Sort, Explain: Learning to Diagnose Translation Models
  28 Mar 2019 · 1 repository · arXiv:1903.12017
• Automatic Spelling Correction with Transformer for CTC-based End-to-End Speech Recognition
  27 Mar 2019 · 0 repositories · arXiv:1904.10045
• SciBERT: A Pretrained Language Model for Scientific Text
  26 Mar 2019 · 6 repositories · arXiv:1903.10676
• Simple Applications of BERT for Ad Hoc Document Retrieval
  26 Mar 2019 · 2 repositories · arXiv:1903.10972
• Fine-tune BERT for Extractive Summarization
  25 Mar 2019 · 12 repositories · arXiv:1903.10318
  Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generation
  25 Mar 2019 · 0 repositories · arXiv:1903.10122
• On Measuring Social Biases in Sentence Encoders
  25 Mar 2019 · 1 repository · arXiv:1903.10561
• Recognizing Arrow Of Time In The Short Stories
  25 Mar 2019 · 1 repository · arXiv:1903.10548
• Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
  22 Mar 2019 · 8 repositories · arXiv:1903.09588
  Syntology official (archive's flag): 8 ran · 19 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 3 honoured, 0 violated, 12 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 27 harvested samples) · 9 pointer-only (licence)
• Learning Multi-Level Information for Dialogue Response Selection by Highway Recurrent Transformer
  21 Mar 2019 · 0 repositories · arXiv:1903.08953
• Linguistic Knowledge and Transferability of Contextual Representations
  21 Mar 2019 · 0 repositories · arXiv:1903.08855
• Selective Attention for Context-aware Neural Machine Translation
  21 Mar 2019 · 1 repository · arXiv:1903.08788
• Cloze-driven Pretraining of Self-attention Networks
  19 Mar 2019 · 0 repositories · arXiv:1903.07785
• Neutron: An Implementation of the Transformer Translation Model and its Variants
  18 Mar 2019 · 2 repositories · arXiv:1903.07402
• STNReID : Deep Convolutional Networks with Pairwise Spatial Transformer Networks for Partial Person Re-identification
  17 Mar 2019 · 0 repositories · arXiv:1903.07072
• Deep Patent Landscaping Model Using Transformer and Graph Embedding
  14 Mar 2019 · 0 repositories · arXiv:1903.05823
• Episodic Memory Reader: Learning What to Remember for Question Answering from Streaming Data
  14 Mar 2019 · 1 repository · arXiv:1903.06164
• Communication-efficient distributed SGD with Sketching
  12 Mar 2019 · 2 repositories · arXiv:1903.04488
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• HLT@SUDA at SemEval 2019 Task 1: UCCA Graph Parsing as Constituent Tree Parsing
  11 Mar 2019 · 0 repositories · arXiv:1903.04153
• Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks
  9 Mar 2019 · 0 repositories · arXiv:1903.03878
• Dixit: Interactive Visual Storytelling via Term Manipulation
  6 Mar 2019 · 0 repositories · arXiv:1903.02230
• GQ-STN: Optimizing One-Shot Grasp Detection based on Robustness Classifier
  6 Mar 2019 · 0 repositories · arXiv:1903.02489
• adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection
  3 Mar 2019 · 2 repositories · arXiv:1903.00904
• Frequency Domain Transformer Networks for Video Prediction
  1 Mar 2019 · 1 repository · arXiv:1903.00271
• BERT for Joint Intent Classification and Slot Filling
  28 Feb 2019 · 16 repositories · arXiv:1902.10909
  Syntology 26 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 7 where Syntology's instrument failed) · 6 unverified (of 32 harvested samples) · 5 pointer-only (licence)
• Attentional Encoder Network for Targeted Sentiment Classification
  25 Feb 2019 · 5 repositories · arXiv:1902.09314
• Pretraining-Based Natural Language Generation for Text Summarization
  25 Feb 2019 · 4 repositories · arXiv:1902.09243
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Star-Transformer
  25 Feb 2019 · 2 repositories · arXiv:1902.09113
  Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)
• Enhancing Clinical Concept Extraction with Contextual Embeddings
  22 Feb 2019 · 0 repositories · arXiv:1902.08691
• Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreement
  15 Feb 2019 · 0 repositories · arXiv:1902.05770
• Actions Generation from Captions
  14 Feb 2019 · 0 repositories · arXiv:1902.11109
• Language Models are Unsupervised Multitask Learners
  14 Feb 2019 · 21 repositories
• Machine Reading Comprehension for Answer Re-Ranking in Customer Support Chatbots
  12 Feb 2019 · 0 repositories · arXiv:1902.04574
• BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model
  11 Feb 2019 · 13 repositories · arXiv:1902.04094
  Syntology official (archive's flag): 2 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 2 pointer-only (licence)
• Improving Deep Image Clustering With Spatial Transformer Layers
  9 Feb 2019 · 0 repositories · arXiv:1902.05401
• Insertion Transformer: Flexible Sequence Generation via Insertion Operations
  8 Feb 2019 · 0 repositories · arXiv:1902.03249
• BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning
  7 Feb 2019 · 2 repositories · arXiv:1902.02671
• AlphaStar: An Evolutionary Computation Perspective
  5 Feb 2019 · 0 repositories · arXiv:1902.01724
• End-to-End Open-Domain Question Answering with BERTserini
  5 Feb 2019 · 1 repository · arXiv:1902.01718
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 3 pointer-only (licence)
• A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
  4 Feb 2019 · 5 repositories · arXiv:1902.01069
  Syntology official (archive's flag): 3 ran · 21 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 2 violated, 1 with no contract checked; 16 where Syntology's instrument failed) · 15 unverified (of 36 harvested samples) · 33 pointer-only (licence)
• Insertion-based Decoding with automatically Inferred Generation Order
  4 Feb 2019 · 0 repositories · arXiv:1902.01370
• Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
  4 Feb 2019 · 6 repositories · arXiv:1902.01007
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Parameter-Efficient Transfer Learning for NLP
  2 Feb 2019 · 17 repositories · arXiv:1902.00751
  Syntology official: harvested, nothing ran · 14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 22 harvested samples) · 3 pointer-only (licence)
• Adding Interpretable Attention to Neural Translation Models Improves Word Alignment
  31 Jan 2019 · 1 repository · arXiv:1901.11359
• Multi-Task Deep Neural Networks for Natural Language Understanding
  31 Jan 2019 · 7 repositories · arXiv:1901.11504
  Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 4 pointer-only (licence)
• The Second Conversational Intelligence Challenge (ConvAI2)
  31 Jan 2019 · 2 repositories · arXiv:1902.00098
• The Evolved Transformer
  30 Jan 2019 · 3 repositories · arXiv:1901.11117
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
  25 Jan 2019 · 19 repositories · arXiv:1901.08746
  Syntology official: no sample here; runs from other or unrecorded repositories · 15 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (of 25 harvested samples) · 3 pointer-only (licence)
• A BERT Baseline for the Natural Questions
  24 Jan 2019 · 3 repositories · arXiv:1901.08634
  Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
• Self-Attentive Model for Headline Generation
  23 Jan 2019 · 0 repositories · arXiv:1901.07786
• TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
  23 Jan 2019 · 23 repositories · arXiv:1901.08149
  Syntology 18 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 7 where Syntology's instrument failed) · 8 unverified (of 26 harvested samples) · 7 pointer-only (licence)
• Cross-lingual Language Model Pretraining
  22 Jan 2019 · 17 repositories · arXiv:1901.07291
  Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Linearized Multi-Sampling for Differentiable Image Transformation
  22 Jan 2019 · 1 repository · arXiv:1901.07124
• Assessing BERT's Syntactic Abilities
  16 Jan 2019 · 3 repositories · arXiv:1901.05287
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Passage Re-ranking with BERT
  13 Jan 2019 · 6 repositories · arXiv:1901.04085
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)