Methods › General › Attention Modules › Multi-Head Attention › Papers, page 211
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 211 of 249: papers 21,001 to 21,100 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 24 Mar 2021 · 0 repositories · arXiv:2103.13033
-
Vision Transformers for Dense Prediction 24 Mar 2021 · 15 repositories · arXiv:2103.13413Syntology 65 ran (of which 19 constructed an object rather than computing a result; 32 with no instrument failure: 0 honoured, 0 violated, 32 with no contract checked; 33 where Syntology's instrument failed) · 51 unverified (of 116 harvested samples) · 15 pointer-only (licence)
-
Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection 23 Mar 2021 · 0 repositories · arXiv:2103.12450
-
Detecting Hate Speech with GPT-3 23 Mar 2021 · 2 repositories · arXiv:2103.12407
-
Repairing Pronouns in Translation with BERT-Based Post-Editing 23 Mar 2021 · 0 repositories · arXiv:2103.12838
-
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures 23 Mar 2021 · 0 repositories · arXiv:2104.10640
-
TMR: Evaluating NER Recall on Tough Mentions 23 Mar 2021 · 0 repositories · arXiv:2103.12312
-
Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling 23 Mar 2021 · 0 repositories · arXiv:2103.12801
-
BERT: A Review of Applications in Natural Language Processing and Understanding 22 Mar 2021 · 0 repositories · arXiv:2103.11943
-
Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis management 22 Mar 2021 · 0 repositories · arXiv:2103.11835
-
End-to-End Trainable Multi-Instance Pose Estimation with Transformers 22 Mar 2021 · 2 repositories · arXiv:2103.12115Syntology official (archive's flag): 10 ran · 15 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 1 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 8 pointer-only (licence)
-
PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT 22 Mar 2021 · 2 repositories · arXiv:2103.11933
-
Identifying Machine-Paraphrased Plagiarism 22 Mar 2021 · 2 repositories · arXiv:2103.11909
-
Incorporating Convolution Designs into Visual Transformers 22 Mar 2021 · 3 repositories · arXiv:2103.11816Syntology official (archive's flag): 5 ran · 9 ran (of which 9 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 9 samples that ran constructed an object rather than computing a result (of 11 harvested samples)
-
Meta-DETR: Image-Level Few-Shot Object Detection with Inter-Class Correlation Exploitation 22 Mar 2021 · 2 repositories · arXiv:2103.11731Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Open Domain Question Answering over Tables via Dense Retrieval 22 Mar 2021 · 1 repository · arXiv:2103.12011
-
Tiny Transformers for Environmental Sound Classification at the Edge 22 Mar 2021 · 1 repository · arXiv:2103.12157
-
An Unsupervised Sampling Approach for Image-Sentence Matching Using Document-Level Structural Information 21 Mar 2021 · 0 repositories · arXiv:2104.02605
-
MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation 21 Mar 2021 · 0 repositories · arXiv:2103.11374
-
NameRec*: Highly Accurate and Fine-grained Person Name Recognition 21 Mar 2021 · 0 repositories · arXiv:2103.11360
-
Non-Autoregressive Translation by Learning Target Categorical Codes 21 Mar 2021 · 1 repository · arXiv:2103.11405
-
Paying Attention to Activation Maps in Camera Pose Regression 21 Mar 2021 · 0 repositories · arXiv:2103.11477
-
ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques 21 Mar 2021 · 1 repository · arXiv:2103.11367Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Attention-Based Multimodal Image Matching 20 Mar 2021 · 1 repository · arXiv:2103.11247
-
API2Com: On the Improvement of Automatically Generated Code Comments Using API Documentations 19 Mar 2021 · 0 repositories · arXiv:2103.10668
-
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases 19 Mar 2021 · 9 repositories · arXiv:2103.10697
-
Cost-effective Deployment of BERT Models in Serverless Environment 19 Mar 2021 · 0 repositories · arXiv:2103.10673
-
Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full version 19 Mar 2021 · 0 repositories · arXiv:2103.10760
-
Hopper: Multi-hop Transformer for Spatiotemporal Reasoning 19 Mar 2021 · 1 repository · arXiv:2103.10574
-
Let Your Heart Speak in its Mother Tongue: Multilingual Captioning of Cardiac Signals 19 Mar 2021 · 1 repository · arXiv:2103.11011
-
MuRIL: Multilingual Representations for Indian Languages 19 Mar 2021 · 1 repository · arXiv:2103.10730
-
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation 19 Mar 2021 · 0 repositories · arXiv:2103.10918
-
Scalable Vision Transformers with Hierarchical Pooling 19 Mar 2021 · 2 repositories · arXiv:2103.10619Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Transferable Model for Shape Optimization subject to Physical Constraints 19 Mar 2021 · 0 repositories · arXiv:2103.10805
-
GLM: General Language Model Pretraining with Autoregressive Blank Infilling 18 Mar 2021 · 8 repositories · arXiv:2103.10360Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Contextual Biasing of Language Models for Speech Recognition in Goal-Oriented Conversational Agents 18 Mar 2021 · 0 repositories · arXiv:2103.10325
-
Danish Fungi 2020 -- Not Just Another Image Recognition Dataset 18 Mar 2021 · 1 repository · arXiv:2103.10107
-
Enhancing Transformer for Video Understanding Using Gated Multi-Level Attention and Temporal Adversarial Training 18 Mar 2021 · 0 repositories · arXiv:2103.10043
-
GPT Understands, Too 18 Mar 2021 · 10 repositories · arXiv:2103.10385Syntology official (archive's flag): 1 ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Model Extraction and Adversarial Transferability, Your BERT is Vulnerable! 18 Mar 2021 · 1 repository · arXiv:2103.10013
-
SPICES: SURVEY PAPERS AS INTERACTIVE CHEATSHEET EMBEDDINGS 18 Mar 2021 · 0 repositories
-
UNETR: Transformers for 3D Medical Image Segmentation 18 Mar 2021 · 10 repositories · arXiv:2103.10504
-
Code Word Detection in Fraud Investigations using a Deep-Learning Approach 17 Mar 2021 · 0 repositories · arXiv:2103.09606
-
On the Role of Images for Analyzing Claims in Social Media 17 Mar 2021 · 1 repository · arXiv:2103.09602
-
SILT: Efficient transformer training for inter-lingual inference 17 Mar 2021 · 0 repositories · arXiv:2103.09635
-
Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformer 17 Mar 2021 · 1 repository · arXiv:2103.09712
-
UniParma at SemEval-2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model 17 Mar 2021 · 1 repository · arXiv:2103.09645
-
You Only Look One-level Feature 17 Mar 2021 · 6 repositories · arXiv:2103.09460
-
Dense Interaction Learning for Video-based Person Re-identification 16 Mar 2021 · 0 repositories · arXiv:2103.09013
-
KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph 16 Mar 2021 · 0 repositories · arXiv:2103.08893
-
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval 16 Mar 2021 · 2 repositories · arXiv:2103.08784Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Robustly Optimized and Distilled Training for Natural Language Understanding 16 Mar 2021 · 0 repositories · arXiv:2103.08809
-
Knowledge driven Description Synthesis for Floor Plan Interpretation 15 Mar 2021 · 0 repositories · arXiv:2103.08298
-
Improving Code Summarization with Block-wise Abstract Syntax Tree Splitting 14 Mar 2021 · 1 repository · arXiv:2103.07845
-
SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels 14 Mar 2021 · 0 repositories · arXiv:2103.07829
-
TransFG: A Transformer Architecture for Fine-grained Recognition 14 Mar 2021 · 2 repositories · arXiv:2103.07976Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Approximating How Single Head Attention Learns 13 Mar 2021 · 1 repository · arXiv:2103.07601
-
Optimal Embedding Calibration for Symbolic Music Similarity 13 Mar 2021 · 0 repositories · arXiv:2103.07656
-
Targeted aspect based multimodal sentiment analysis:an attention capsule extraction and multi-head fusion network 13 Mar 2021 · 0 repositories · arXiv:2103.07659
-
Text Mining of Stocktwits Data for Predicting Stock Prices 13 Mar 2021 · 0 repositories · arXiv:2103.16388
-
Bilingual Dictionary-based Language Model Pretraining for Neural Machine Translation 12 Mar 2021 · 0 repositories · arXiv:2103.07040
-
Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech 12 Mar 2021 · 0 repositories · arXiv:2103.11792
-
Explaining and Improving BERT Performance on Lexical Semantic Change Detection 12 Mar 2021 · 0 repositories · arXiv:2103.07259
-
Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability 12 Mar 2021 · 0 repositories · arXiv:2103.07162
-
Neural Architecture Search based on Cartesian Genetic Programming Coding Method 12 Mar 2021 · 0 repositories · arXiv:2103.07173
-
Predicting the Behavior of Dealers in Over-The-Counter Corporate Bond Markets 12 Mar 2021 · 0 repositories · arXiv:2103.09098
-
Sequential Random Network for Fine-grained Image Classification 12 Mar 2021 · 0 repositories · arXiv:2103.07230
-
Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer 12 Mar 2021 · 0 repositories · arXiv:2103.07062
-
Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus 12 Mar 2021 · 0 repositories · arXiv:2103.07055
-
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation 11 Mar 2021 · 6 repositories · arXiv:2103.06874
-
Composite Re-Ranking for Efficient Document Search with BERT 11 Mar 2021 · 0 repositories · arXiv:2103.06499
-
Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks 11 Mar 2021 · 0 repositories · arXiv:2103.06982
-
Evaluation of Morphological Embeddings for the Russian Language 11 Mar 2021 · 0 repositories · arXiv:2103.06628
-
FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders 11 Mar 2021 · 0 repositories · arXiv:2103.06413
-
Improving Bi-encoder Document Ranking Models with Two Rankers and Multi-teacher Distillation 11 Mar 2021 · 1 repository · arXiv:2103.06523
-
LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation 11 Mar 2021 · 0 repositories · arXiv:2103.06418
-
On Improving Deep Learning Trace Analysis with System Call Arguments 11 Mar 2021 · 0 repositories · arXiv:2103.06915
-
Self-supervised Text-to-SQL Learning with Header Alignment Training 11 Mar 2021 · 0 repositories · arXiv:2103.06402
-
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings 11 Mar 2021 · 1 repository · arXiv:2103.06459
-
Unknown Object Segmentation from Stereo Images 11 Mar 2021 · 2 repositories · arXiv:2103.06796
-
CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review 10 Mar 2021 · 2 repositories · arXiv:2103.06268
-
Hurdles to Progress in Long-form Question Answering 10 Mar 2021 · 2 repositories · arXiv:2103.06332
-
Majority Voting with Bidirectional Pre-translation For Bitext Retrieval 10 Mar 2021 · 1 repository · arXiv:2103.06369
-
CEQE: Contextualized Embeddings for Query Expansion 9 Mar 2021 · 0 repositories · arXiv:2103.05256
-
Pretrained Transformers as Universal Computation Engines 9 Mar 2021 · 4 repositories · arXiv:2103.05247
-
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do 8 Mar 2021 · 1 repository · arXiv:2103.11790Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
SKILLBERT: “SKILLING” THE BERT TO CLASSIFY SKILLS! 8 Mar 2021 · 0 repositories
-
MTLHealth: A Deep Learning System for Detecting Disturbing Content in Student Essays 7 Mar 2021 · 0 repositories · arXiv:2103.04290
-
Orthogonal Attention: A Cloze-Style Approach to Negation Scope Resolution 7 Mar 2021 · 0 repositories · arXiv:2103.04294
-
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees 7 Mar 2021 · 1 repository · arXiv:2103.04350
-
TransBTS: Multimodal Brain Tumor Segmentation Using Transformer 7 Mar 2021 · 3 repositories · arXiv:2103.04430
-
Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech 6 Mar 2021 · 1 repository · arXiv:2103.04088
-
Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth 5 Mar 2021 · 1 repository · arXiv:2103.03404
-
Dual Pointer Network for Fast Extraction of Multiple Relations in a Sentence 5 Mar 2021 · 0 repositories · arXiv:2103.03509
-
Fine-tuning Pretrained Multilingual BERT Model for Indonesian Aspect-based Sentiment Analysis 5 Mar 2021 · 0 repositories · arXiv:2103.03732
-
Hierarchical Transformer for Multilingual Machine Translation 5 Mar 2021 · 0 repositories · arXiv:2103.03589
-
IOT: Instance-wise Layer Reordering for Transformer Structures 5 Mar 2021 · 1 repository · arXiv:2103.03457Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
-
MalBERT: Using Transformers for Cybersecurity and Malicious Software Detection 5 Mar 2021 · 0 repositories · arXiv:2103.03806
-
Measuring Mathematical Problem Solving With the MATH Dataset 5 Mar 2021 · 5 repositories · arXiv:2103.03874Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Non-invasive Self-attention for Side Information Fusion in Sequential Recommendation 5 Mar 2021 · 0 repositories · arXiv:2103.03578