Methods › General › Attention Modules › Multi-Head Attention › Papers, page 227

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 227 of 249: papers 22,601 to 22,700 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Feature Pyramid Transformer
  18 Jul 2020 · 0 repositories · arXiv:2007.09451
• Temporal Pointwise Convolutional Networks for Length of Stay Prediction in the Intensive Care Unit
  18 Jul 2020 · 1 repository · arXiv:2007.09483
• Deep Learning Based Traffic Surveillance System For Missing and Suspicious Car Detection
  17 Jul 2020 · 0 repositories · arXiv:2007.08783
• Generative Pretraining from Pixels
  17 Jul 2020 · 4 repositories
• Multi-Perspective Semantic Information Retrieval in the Biomedical Domain
  17 Jul 2020 · 0 repositories · arXiv:2008.01526
• Hopfield Networks is All You Need
  16 Jul 2020 · 3 repositories · arXiv:2008.02217
  Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
• Investigating Pretrained Language Models for Graph-to-Text Generation
  16 Jul 2020 · 3 repositories · arXiv:2007.08426
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 2 pointer-only (licence)
• Towards Debiasing Sentence Representations
  16 Jul 2020 · 1 repository · arXiv:2007.08100
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Translate Reverberated Speech to Anechoic Ones: Speech Dereverberation with BERT
  16 Jul 2020 · 0 repositories · arXiv:2007.08052
• AdapterHub: A Framework for Adapting Transformers
  15 Jul 2020 · 9 repositories · arXiv:2007.07779
  Syntology official (archive's flag): 1 ran · 11 ran (of which 2 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 15 harvested samples) · 12 pointer-only (licence)
• Deep Reinforced Query Reformulation for Information Retrieval
  15 Jul 2020 · 0 repositories · arXiv:2007.07987
• Fine-Tune Longformer for Jointly Predicting Rumor Stance and Veracity
  15 Jul 2020 · 0 repositories · arXiv:2007.07803
• InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
  15 Jul 2020 · 4 repositories · arXiv:2007.07834
• Logic Constrained Pointer Networks for Interpretable Textual Similarity
  15 Jul 2020 · 1 repository · arXiv:2007.07670
• Multimodal Word Sense Disambiguation in Creative Practice
  15 Jul 2020 · 1 repository · arXiv:2007.07758
• Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media
  15 Jul 2020 · 3 repositories · arXiv:2007.07997
• Predicting Clinical Diagnosis from Patients Electronic Health Records Using BERT-based Neural Networks
  15 Jul 2020 · 0 repositories · arXiv:2007.07562
• The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction
  15 Jul 2020 · 0 repositories · arXiv:2007.08620
• Add a SideNet to your MainNet
  14 Jul 2020 · 0 repositories · arXiv:2007.13512
• An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models
  14 Jul 2020 · 1 repository · arXiv:2007.06778
• Can neural networks acquire a structural bias from raw linguistic data?
  14 Jul 2020 · 0 repositories · arXiv:2007.06761
• CoreGen: Contextualized Code Representation Learning for Commit Message Generation
  14 Jul 2020 · 1 repository · arXiv:2007.06934
• Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASR
  14 Jul 2020 · 0 repositories · arXiv:2007.06949
• Emoji Prediction: Extensions and Benchmarking
  14 Jul 2020 · 1 repository · arXiv:2007.07389
• Optimizing Memory Placement using Evolutionary Graph Reinforcement Learning
  14 Jul 2020 · 0 repositories · arXiv:2007.07298
• What's in a Name? Are BERT Named Entity Representations just as Good for any other Name?
  14 Jul 2020 · 0 repositories · arXiv:2007.06897
• An Enhanced Text Classification to Explore Health based Indian Government Policy Tweets
  13 Jul 2020 · 0 repositories · arXiv:2007.06511
• Paranoid Transformer: Reading Narrative of Madness as Computational Approach to Creativity
  13 Jul 2020 · 1 repository · arXiv:2007.06290
• Rewiring the Transformer with Depth-Wise LSTMs
  13 Jul 2020 · 0 repositories · arXiv:2007.06257
• HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections
  12 Jul 2020 · 0 repositories · arXiv:2007.05891
• Sparse Graph to Sequence Learning for Vision Conditioned Long Textual Sequence Generation
  12 Jul 2020 · 0 repositories · arXiv:2007.06077
• TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
  12 Jul 2020 · 7 repositories · arXiv:2007.06028
  Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 3 pointer-only (licence)
• BERT Learns (and Teaches) Chemistry
  11 Jul 2020 · 0 repositories · arXiv:2007.16012
• Generative Compositional Augmentations for Scene Graph Prediction
  11 Jul 2020 · 1 repository · arXiv:2007.05756
• Sequence Generation with Mixed Representations
  11 Jul 2020 · 1 repository
• GLOW : Global Weighted Self-Attention Network for Web Search
  10 Jul 2020 · 1 repository · arXiv:2007.05186
• Multi-Dialect Arabic BERT for Country-Level Dialect Identification
  10 Jul 2020 · 1 repository · arXiv:2007.05612
• To BAN or not to BAN: Bayesian Attention Networks for Reliable Hate Speech Detection
  10 Jul 2020 · 0 repositories · arXiv:2007.05304
• Advances of Transformer-Based Models for News Headline Generation
  9 Jul 2020 · 2 repositories · arXiv:2007.05044
• Contrastive Code Representation Learning
  9 Jul 2020 · 1 repository · arXiv:2007.04973
• DeepSinger: Singing Voice Synthesis with Data Mined From the Web
  9 Jul 2020 · 0 repositories · arXiv:2007.04590
• Fast Transformers with Clustered Attention
  9 Jul 2020 · 1 repository · arXiv:2007.04825
• Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers
  8 Jul 2020 · 0 repositories · arXiv:2007.03848
• Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature
  7 Jul 2020 · 1 repository · arXiv:2007.03405
• Do Transformers Need Deep Long-Range Memory
  7 Jul 2020 · 1 repository · arXiv:2007.03356
• Pre-Trained Models for Heterogeneous Information Networks
  7 Jul 2020 · 0 repositories · arXiv:2007.03184
• The Go Transformer: Natural Language Modeling for Game Play
  7 Jul 2020 · 0 repositories · arXiv:2007.03500
• Deep Contextual Embeddings for Address Classification in E-commerce
  6 Jul 2020 · 0 repositories · arXiv:2007.03020
• Learning to Segment Anatomical Structures Accurately from One Exemplar
  6 Jul 2020 · 0 repositories · arXiv:2007.03052
• LMVE at SemEval-2020 Task 4: Commonsense Validation and Explanation using Pretraining Language Model
  6 Jul 2020 · 0 repositories · arXiv:2007.02540
• Relevance Transformer: Generating Concise Code Snippets with Relevance Feedback
  6 Jul 2020 · 0 repositories · arXiv:2007.02609
• You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion
  5 Jul 2020 · 0 repositories · arXiv:2007.02220
• Robust Prediction of Punctuation and Truecasing for Medical ASR
  4 Jul 2020 · 0 repositories · arXiv:2007.02025
• Text Data Augmentation: Towards better detection of spear-phishing emails
  4 Jul 2020 · 0 repositories · arXiv:2007.02033
• Abstractive and mixed summarization for long-single documents
  3 Jul 2020 · 0 repositories · arXiv:2007.01918
• Language-agnostic BERT Sentence Embedding
  3 Jul 2020 · 6 repositories · arXiv:2007.01852
• MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks
  3 Jul 2020 · 0 repositories · arXiv:2007.01510
• On-The-Fly Information Retrieval Augmentation for Language Models
  3 Jul 2020 · 0 repositories · arXiv:2007.01528
• Playing with Words at the National Library of Sweden -- Making a Swedish BERT
  3 Jul 2020 · 1 repository · arXiv:2007.01658
• Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning
  3 Jul 2020 · 0 repositories · arXiv:2007.01836
• Reading Comprehension in Czech via Machine Translation and Cross-lingual Transfer
  3 Jul 2020 · 0 repositories · arXiv:2007.01667
• Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odyssey
  2 Jul 2020 · 0 repositories · arXiv:2007.01127
• Detecting Ongoing Events Using Contextual Word and Sentence Embeddings
  2 Jul 2020 · 0 repositories · arXiv:2007.01379
• The Impact of Explanations on AI Competency Prediction in VQA
  2 Jul 2020 · 0 repositories · arXiv:2007.00900
• A BERT-based One-Pass Multi-Task Model for Clinical Temporal Relation Extraction
  1 Jul 2020 · 0 repositories
• A Generate-and-Rank Framework with Semantic Type Regularization for Biomedical Concept Normalization
  1 Jul 2020 · 0 repositories
• A Metric Learning Approach to Misogyny Categorization
  1 Jul 2020 · 0 repositories
• A Mixture of h - 1 Heads is Better than h Heads
  1 Jul 2020 · 0 repositories
• A Simple and Effective Dependency Parser for Telugu
  1 Jul 2020 · 0 repositories
• A Transformer Approach to Contextual Sarcasm Detection in Twitter
  1 Jul 2020 · 0 repositories
• Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal Dependency Parsing
  1 Jul 2020 · 0 repositories
• Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation
  1 Jul 2020 · 0 repositories
• Adversarial and Domain-Aware BERT for Cross-Domain Sentiment Analysis
  1 Jul 2020 · 0 repositories
• Adversarial Evaluation of BERT for Biomedical Named Entity Recognition
  1 Jul 2020 · 0 repositories
• An empirical investigation of neural methods for content scoring of science explanations
  1 Jul 2020 · 0 repositories
• Automatic Generation of Citation Texts in Scholarly Papers: A Pilot Study
  1 Jul 2020 · 0 repositories
• CASIA's System for IWSLT 2020 Open Domain Translation
  1 Jul 2020 · 0 repositories
• Character aware models with similarity learning for metaphor detection
  1 Jul 2020 · 0 repositories
• Combining Subword Representations into Word-level Representations in the Transformer Architecture
  1 Jul 2020 · 0 repositories
• Compressing Neural Machine Translation Models with 4-bit Precision
  1 Jul 2020 · 0 repositories
• Context-Aware Sarcasm Detection Using BERT
  1 Jul 2020 · 0 repositories
• Contextual and Non-Contextual Word Embeddings: an in-depth Linguistic Investigation
  1 Jul 2020 · 0 repositories
• Contextualized Emotion Recognition in Conversation as Sequence Tagging
  1 Jul 2020 · 0 repositories
• CopyBERT: A Unified Approach to Question Generation with Self-Attention
  1 Jul 2020 · 0 repositories
• Cross-Lingual Disaster-related Multi-label Tweet Classification with Manifold Mixup
  1 Jul 2020 · 1 repository
• Data Augmentation for Transformer-based G2P
  1 Jul 2020 · 0 repositories
• Deep Blue Sonics' Submission to IWSLT 2020 Open Domain Translation Task
  1 Jul 2020 · 0 repositories
• Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment Classification
  1 Jul 2020 · 0 repositories
• Detecting Sarcasm in Conversation Context Using Transformer-Based Models
  1 Jul 2020 · 0 repositories
• DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation
  1 Jul 2020 · 1 repository
• Do Transformers Need Deep Long-Range Memory?
  1 Jul 2020 · 0 repositories
• Efficient and High-Quality Neural Machine Translation with OpenNMT
  1 Jul 2020 · 0 repositories
• End-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning
  1 Jul 2020 · 0 repositories
• End-to-End Simultaneous Translation System for IWSLT2020 Using Modality Agnostic Meta-Learning
  1 Jul 2020 · 0 repositories
• Enhancing Transformer with Sememe Knowledge
  1 Jul 2020 · 0 repositories
• Evaluating the Utility of Model Configurations and Data Augmentation on Clinical Semantic Textual Similarity
  1 Jul 2020 · 0 repositories
• Expand and Filter: CUNI and LMU Systems for the WNGT 2020 Duolingo Shared Task
  1 Jul 2020 · 0 repositories
• Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT
  1 Jul 2020 · 0 repositories
• Feature Projection for Improved Text Classification
  1 Jul 2020 · 0 repositories
• Frustratingly Easy Multilingual Grapheme-to-Phoneme Conversion
  1 Jul 2020 · 0 repositories