Methods › General › Attention Modules › Multi-Head Attention › Papers, page 241

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 241 of 249: papers 24,001 to 24,100 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT
  13 Oct 2019 · 0 repositories · arXiv:1910.05786
• Stabilizing Transformers for Reinforcement Learning
  13 Oct 2019 · 5 repositories · arXiv:1910.06764
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
  12 Oct 2019 · 3 repositories · arXiv:1910.05453
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Automatic segmentation of texts into units of meaning for reading assistance
  11 Oct 2019 · 0 repositories · arXiv:1910.05014
• BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novels
  11 Oct 2019 · 1 repository · arXiv:1910.05040
• exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models
  11 Oct 2019 · 1 repository · arXiv:1910.05276
• Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework
  10 Oct 2019 · 2 repositories · arXiv:1910.04708
• FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams
  10 Oct 2019 · 3 repositories · arXiv:1910.04345
• Multi-label Categorization of Accounts of Sexism using a Neural Framework
  10 Oct 2019 · 1 repository · arXiv:1910.04602
• Multilingual Question Answering from Formatted Text applied to Conversational Agents
  10 Oct 2019 · 0 repositories · arXiv:1910.04659
• On Recognizing Texts of Arbitrary Shapes with 2D Self-Attention
  10 Oct 2019 · 2 repositories · arXiv:1910.04396
• Orthogonality Constrained Multi-Head Attention For Keyword Spotting
  10 Oct 2019 · 0 repositories · arXiv:1910.04500
• Structured Pruning of Large Language Models
  10 Oct 2019 · 2 repositories · arXiv:1910.04732
  Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 2 pointer-only (licence)
• Visual Natural Language Query Auto-Completion for Estimating Instance Probabilities
  10 Oct 2019 · 1 repository · arXiv:1910.04887
• A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
  9 Oct 2019 · 0 repositories · arXiv:1910.04176
• Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models
  9 Oct 2019 · 1 repository · arXiv:1910.03756
• Is Multilingual BERT Fluent in Language Generation?
  9 Oct 2019 · 1 repository · arXiv:1910.03806
• On the adequacy of untuned warmup for adaptive optimization
  9 Oct 2019 · 1 repository · arXiv:1910.04209
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
• PipeMare: Asynchronous Pipeline Parallel DNN Training
  9 Oct 2019 · 0 repositories · arXiv:1910.05124
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
  9 Oct 2019 · 9 repositories · arXiv:1910.03771
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Knowledge Distillation from Internal Representations
  8 Oct 2019 · 0 repositories · arXiv:1910.03723
• Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting
  8 Oct 2019 · 0 repositories · arXiv:1910.03650
• SesameBERT: Attention for Anywhere
  8 Oct 2019 · 0 repositories · arXiv:1910.03176
• BERT for Evidence Retrieval and Claim Verification
  7 Oct 2019 · 2 repositories · arXiv:1910.02655
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Parallel Iterative Edit Models for Local Sequence Transduction
  7 Oct 2019 · 1 repository · arXiv:1910.02893
• SMArT: Training Shallow Memory-aware Transformers for Robotic Explainability
  7 Oct 2019 · 0 repositories · arXiv:1910.02974
• Named Entity Recognition -- Is there a glass ceiling?
  6 Oct 2019 · 1 repository · arXiv:1910.02403
• Attention-based Fault-tolerant Approach for Multi-agent Reinforcement Learning Systems
  5 Oct 2019 · 0 repositories · arXiv:1910.02240
• How Transformer Revitalizes Character-based Neural Machine Translation: An Investigation on Japanese-Vietnamese Translation Systems
  5 Oct 2019 · 1 repository · arXiv:1910.02238
• Distilling BERT into Simple Neural Networks with Unlabeled Transfer Data
  4 Oct 2019 · 0 repositories · arXiv:1910.01769
• Fine-grained Sentiment Classification using BERT
  4 Oct 2019 · 1 repository · arXiv:1910.03474
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
  4 Oct 2019 · 10 repositories · arXiv:1910.02054
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Neural Zero-Inflated Quality Estimation Model For Automatic Speech Recognition System
  3 Oct 2019 · 0 repositories · arXiv:1910.01289
• Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation
  3 Oct 2019 · 1 repository · arXiv:1910.01462
• Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations
  2 Oct 2019 · 0 repositories · arXiv:1910.01157
• DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
  2 Oct 2019 · 37 repositories · arXiv:1910.01108
  Syntology official (archive's flag): 1 ran · 21 ran (of which 5 constructed an object rather than computing a result; 13 with no instrument failure: 3 honoured, 1 violated, 9 with no contract checked; 8 where Syntology's instrument failed) · 6 unverified (of 27 harvested samples) · 2 pointer-only (licence)
• Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
  2 Oct 2019 · 1 repository · arXiv:1910.00883
• Linking artificial and human neural representations of language
  2 Oct 2019 · 1 repository · arXiv:1910.01244
  Syntology 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• Application of Low-resource Machine Translation Techniques to Russian-Tatar Language Pair
  1 Oct 2019 · 0 repositories · arXiv:1910.00368
• Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation
  1 Oct 2019 · 1 repository · arXiv:1910.06717
• BERT for Question Generation
  1 Oct 2019 · 0 repositories
• Dialogue Transformers
  1 Oct 2019 · 1 repository · arXiv:1910.00486
• Efficiency Metrics for Data-Driven Models: A Text Summarization Case Study
  1 Oct 2019 · 0 repositories
• Entangled Transformer for Image Captioning
  1 Oct 2019 · 0 repositories
• Grammatical Error Correction in Low-Resource Scenarios
  1 Oct 2019 · 1 repository · arXiv:1910.00353
• Better Document-Level Machine Translation with Bayes' Rule
  1 Oct 2019 · 0 repositories · arXiv:1910.00553
• Specializing Word Embeddings (for Parsing) by Information Bottleneck
  1 Oct 2019 · 1 repository · arXiv:1910.00163
• TMLab: Generative Enhanced Model (GEM) for adversarial attacks
  1 Oct 2019 · 0 repositories · arXiv:1910.00337
• VAE-PGN based Abstractive Model in Multi-stage Architecture for Text Summarization
  1 Oct 2019 · 0 repositories
• End-to-End Resume Parsing and Finding Candidates for a Job Description using BERT
  30 Sep 2019 · 0 repositories · arXiv:1910.03089
• Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations
  30 Sep 2019 · 0 repositories · arXiv:1910.00058
• Fake news detection using Deep Learning
  29 Sep 2019 · 2 repositories · arXiv:1910.03496
• GDP: Generalized Device Placement for Dataflow Graphs
  28 Sep 2019 · 0 repositories · arXiv:1910.01578
• HateMonitors: Language Agnostic Abuse Detection in Social Media
  27 Sep 2019 · 1 repository · arXiv:1909.12642
• On the use of BERT for Neural Machine Translation
  27 Sep 2019 · 0 repositories · arXiv:1909.12744
• Reweighted Proximal Pruning for Large-Scale Language Representation
  27 Sep 2019 · 0 repositories · arXiv:1909.12486
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  26 Sep 2019 · 48 repositories · arXiv:1909.11942
  Syntology official (archive's flag): 6 ran · 81 ran (of which 17 constructed an object rather than computing a result; 59 with no instrument failure: 4 honoured, 0 violated, 55 with no contract checked; 22 where Syntology's instrument failed) · 45 unverified (of 126 harvested samples) · 28 pointer-only (licence)
• Aspect and Opinion Term Extraction for Hotel Reviews using Transfer Learning and Auxiliary Labels
  26 Sep 2019 · 0 repositories · arXiv:1909.11879
• Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture
  26 Sep 2019 · 0 repositories · arXiv:1909.12411
• Improving Pre-Trained Multilingual Models with Vocabulary Expansion
  26 Sep 2019 · 0 repositories · arXiv:1909.12440
• Monotonic Multihead Attention
  26 Sep 2019 · 3 repositories · arXiv:1909.12406
• Universal Graph Transformer Self-Attention Networks
  26 Sep 2019 · 1 repository · arXiv:1909.11855
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
• Attention Convolutional Binary Neural Tree for Fine-Grained Visual Categorization
  25 Sep 2019 · 2 repositories · arXiv:1909.11378
• Extremely Small BERT Models from Mixed-Vocabulary Training
  25 Sep 2019 · 0 repositories · arXiv:1909.11687
• Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis
  25 Sep 2019 · 0 repositories · arXiv:1909.11297
• Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models
  25 Sep 2019 · 2 repositories · arXiv:1909.11299
• Reducing Transformer Depth on Demand with Structured Dropout
  25 Sep 2019 · 5 repositories · arXiv:1909.11556
• Knowledge-Enriched Transformer for Emotion Detection in Textual Conversations
  24 Sep 2019 · 1 repository · arXiv:1909.10681
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Technical report on Conversational Question Answering
  24 Sep 2019 · 0 repositories · arXiv:1909.10772
• Efficiently Reusing Old Models Across Languages via Transfer Learning
  24 Sep 2019 · 0 repositories · arXiv:1909.10955
• Understanding Semantics from Speech Through Pre-training
  24 Sep 2019 · 0 repositories · arXiv:1909.10924
• Unified Vision-Language Pre-Training for Image Captioning and VQA
  24 Sep 2019 · 3 repositories · arXiv:1909.11059
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
• TinyBERT: Distilling BERT for Natural Language Understanding
  23 Sep 2019 · 10 repositories · arXiv:1909.10351
  Syntology official: harvested, nothing ran · 0 ran · 4 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings
  23 Sep 2019 · 1 repository · arXiv:1909.10430
• Automatic Identification and Normalisation of Physical Measurements in Scientific Literature
  23 Sep 2019 · 1 repository
• Portuguese Named Entity Recognition using BERT-CRF
  23 Sep 2019 · 1 repository · arXiv:1909.10649
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Self-attention based end-to-end Hindi-English Neural Machine Translation
  21 Sep 2019 · 0 repositories · arXiv:1909.09779
• Adversarial Learning of General Transformations for Data Augmentation
  21 Sep 2019 · 0 repositories · arXiv:1909.09801
• BERT Meets Chinese Word Segmentation
  20 Sep 2019 · 0 repositories · arXiv:1909.09292
• AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models
  19 Sep 2019 · 1 repository · arXiv:1909.09251
• How Additional Knowledge can Improve Natural Language Commonsense Question Answering?
  19 Sep 2019 · 0 repositories · arXiv:1909.08855
• Improved Variational Neural Machine Translation by Promoting Mutual Information
  19 Sep 2019 · 0 repositories · arXiv:1909.09237
• Summary Level Training of Sentence Rewriting for Abstractive Summarization
  19 Sep 2019 · 0 repositories · arXiv:1909.08752
• Enriching BERT with Knowledge Graph Embeddings for Document Classification
  18 Sep 2019 · 1 repository · arXiv:1909.08402
• Improving Natural Language Inference with a Pretrained Parser
  18 Sep 2019 · 1 repository · arXiv:1909.08217
• Language models and Automated Essay Scoring
  18 Sep 2019 · 1 repository · arXiv:1909.09482
• Using BERT for Word Sense Disambiguation
  18 Sep 2019 · 0 repositories · arXiv:1909.08358
• Do NLP Models Know Numbers? Probing Numeracy in Embeddings
  17 Sep 2019 · 1 repository · arXiv:1909.07940
• SUPP.AI: Finding Evidence for Supplement-Drug Interactions
  17 Sep 2019 · 1 repository · arXiv:1909.08135
• K-BERT: Enabling Language Representation with Knowledge Graph
  17 Sep 2019 · 2 repositories · arXiv:1909.07606
• Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
  17 Sep 2019 · 10 repositories · arXiv:1909.08053
  Syntology community repositories only · 12 ran (of which 2 constructed an object rather than computing a result; 7 with no instrument failure: 4 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 35 unverified (of 47 harvested samples) · 15 pointer-only (licence)
• Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering
  17 Sep 2019 · 0 repositories · arXiv:1909.07597
• Span-based Joint Entity and Relation Extraction with Transformer Pre-training
  17 Sep 2019 · 3 repositories · arXiv:1909.07755
• A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning
  16 Sep 2019 · 0 repositories · arXiv:1909.06983
• Acoustic scene analysis with multi-head attention networks
  16 Sep 2019 · 1 repository · arXiv:1909.08961
• Hybrid Neural Models For Sequence Modelling: The Best Of Three Worlds
  16 Sep 2019 · 0 repositories · arXiv:1909.07102
• Multilingual Neural Machine Translation for Zero-Resource Languages
  16 Sep 2019 · 1 repository · arXiv:1909.07342
• Probing Natural Language Inference Models through Semantic Fragments
  16 Sep 2019 · 3 repositories · arXiv:1909.07521
• Automatically Extracting Challenge Sets for Non local Phenomena in Neural Machine Translation
  15 Sep 2019 · 1 repository · arXiv:1909.06814
• Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing
  15 Sep 2019 · 1 repository · arXiv:1909.06775