Methods › General › Attention Modules › Multi-Head Attention › Papers, page 202
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 202 of 249: papers 20,101 to 20,200 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Dual Aspect Self-Attention based on Transformer for Remaining Useful Life Prediction 30 Jun 2021 · 1 repository · arXiv:2106.15842
-
Early Risk Detection of Pathological Gambling, Self-Harm and Depression Using BERT 30 Jun 2021 · 0 repositories · arXiv:2106.16175
-
Improving Factual Consistency of Abstractive Summarization on Customer Feedback 30 Jun 2021 · 0 repositories · arXiv:2106.16188
-
The MultiBERTs: BERT Reproductions for Robustness Analysis 30 Jun 2021 · 3 repositories · arXiv:2106.16163Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features 29 Jun 2021 · 1 repository · arXiv:2106.15113
-
FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesis 29 Jun 2021 · 1 repository · arXiv:2106.15123
-
GeoT: A Geometry-aware Transformer for Reliable Molecular Property Prediction and Chemically Interpretable Representation Learning 29 Jun 2021 · 1 repository · arXiv:2106.15516
-
Hate speech detection using static BERT embeddings 29 Jun 2021 · 0 repositories · arXiv:2106.15537
-
Hierarchical Context-Aware Transformers for Non-Autoregressive Text to Speech 29 Jun 2021 · 0 repositories · arXiv:2106.15144
-
Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images 29 Jun 2021 · 1 repository · arXiv:2106.15754
-
Multi-Exit Vision Transformer for Dynamic Inference 29 Jun 2021 · 0 repositories · arXiv:2106.15183
-
New Arabic Medical Dataset for Diseases Classification 29 Jun 2021 · 0 repositories · arXiv:2106.15236
-
Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance 29 Jun 2021 · 1 repository · arXiv:2107.02027
-
Digging Errors in NMT: Evaluating and Understanding Model Errors from Partial Hypothesis Space 29 Jun 2021 · 0 repositories · arXiv:2106.15217
-
Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue 29 Jun 2021 · 1 repository · arXiv:2106.15550
-
A 3D CNN Network with BERT For Automatic COVID-19 Diagnosis From CT-Scan Images 28 Jun 2021 · 1 repository · arXiv:2106.14403
-
A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models 28 Jun 2021 · 0 repositories · arXiv:2106.14444
-
Complexity-based partitioning of CSFI problem instances with Transformers 28 Jun 2021 · 0 repositories · arXiv:2106.14481
-
Current Landscape of the Russian Sentiment Corpora 28 Jun 2021 · 0 repositories · arXiv:2106.14434
-
Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU 28 Jun 2021 · 0 repositories · arXiv:2106.14464
-
Multi-Compound Transformer for Accurate Biomedical Image Segmentation 28 Jun 2021 · 1 repository · arXiv:2106.14385
-
R-Drop: Regularized Dropout for Neural Networks 28 Jun 2021 · 8 repositories · arXiv:2106.14448Syntology community repositories only · 4 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Rethinking Token-Mixing MLP for MLP-based Vision Backbone 28 Jun 2021 · 0 repositories · arXiv:2106.14882
-
TENT: Tensorized Encoder Transformer for Temperature Forecasting 28 Jun 2021 · 1 repository · arXiv:2106.14742
-
Traditional Machine Learning and Deep Learning Models for Argumentation Mining in Russian Texts 28 Jun 2021 · 0 repositories · arXiv:2106.14438
-
What's in a Measurement? Using GPT-3 on SemEval 2021 Task 8 -- MeasEval 28 Jun 2021 · 0 repositories · arXiv:2106.14720
-
A Closer Look at How Fine-tuning Changes BERT 27 Jun 2021 · 1 repository · arXiv:2106.14282Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Reinforcement Learning Approach for Sequential Spatial Transformer Networks 27 Jun 2021 · 0 repositories · arXiv:2106.14295
-
AI based Presentation Creator With Customized Audio Content Delivery 27 Jun 2021 · 0 repositories · arXiv:2106.14213
-
Power Law Graph Transformer for Machine Translation and Representation Learning 27 Jun 2021 · 3 repositories · arXiv:2107.02039
-
SymbolicGPT: A Generative Transformer Model for Symbolic Regression 27 Jun 2021 · 2 repositories · arXiv:2106.14131Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
WVOQ at SemEval-2021 Task 6: BART for Span Detection and Classification 27 Jun 2021 · 1 repository · arXiv:2107.05467
-
Answering Chinese Elementary School Social Study Multiple Choice Questions 26 Jun 2021 · 0 repositories · arXiv:2107.02893
-
Benchmarking Differential Privacy and Federated Learning for BERT Models 26 Jun 2021 · 1 repository · arXiv:2106.13973
-
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update 26 Jun 2021 · 0 repositories · arXiv:2106.13914
-
OffRoadTranSeg: Semi-Supervised Segmentation using Transformers on OffRoad environments 26 Jun 2021 · 0 repositories · arXiv:2106.13963
-
SpreadsheetCoder: Formula Prediction from Semi-structured Context 26 Jun 2021 · 1 repository · arXiv:2106.15339
-
Toward Less Hidden Cost of Code Completion with Acceptance and Ranking Models 26 Jun 2021 · 0 repositories · arXiv:2106.13928
-
UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning 26 Jun 2021 · 1 repository · arXiv:2106.14019Syntology official (archive's flag): 7 ran · 7 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples)
-
A Picture May Be Worth a Hundred Words for Visual Question Answering 25 Jun 2021 · 0 repositories · arXiv:2106.13445
-
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains 25 Jun 2021 · 0 repositories · arXiv:2106.13474
-
Learning to Sample Replacements for ELECTRA Pre-Training 25 Jun 2021 · 0 repositories · arXiv:2106.13715
-
NP-DRAW: A Non-Parametric Structured Latent Variable Model for Image Generation 25 Jun 2021 · 1 repository · arXiv:2106.13435
-
Privileged Zero-Shot AutoML 25 Jun 2021 · 0 repositories · arXiv:2106.13743
-
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training 25 Jun 2021 · 0 repositories · arXiv:2106.13488
-
PVT v2: Improved Baselines with Pyramid Vision Transformer 25 Jun 2021 · 18 repositories · arXiv:2106.13797
-
To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernels 25 Jun 2021 · 0 repositories · arXiv:2106.13381
-
ViTAS: Vision Transformer Architecture Search 25 Jun 2021 · 1 repository · arXiv:2106.13700
-
XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages 25 Jun 2021 · 2 repositories · arXiv:2106.13822Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
An Automated Knowledge Mining and Document Classification System with Multi-model Transfer Learning 24 Jun 2021 · 0 repositories · arXiv:2106.12744
-
An Efficient Group-based Search Engine Marketing System for E-Commerce 24 Jun 2021 · 0 repositories · arXiv:2106.12700
-
Discovering novel drug-supplement interactions using a dietary supplements knowledge graph generated from the biomedical literature 24 Jun 2021 · 0 repositories · arXiv:2106.12741
-
Education-to-Skill Mapping Using Hierarchical Classification and Transformer Neural Network 24 Jun 2021 · 1 repository
-
Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixers 24 Jun 2021 · 1 repository · arXiv:2106.13122
-
Learning Multiple Stock Trading Patterns with Temporal Routing Adaptor and Optimal Transport 24 Jun 2021 · 1 repository · arXiv:2106.12950
-
Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical study 24 Jun 2021 · 0 repositories · arXiv:2106.13035
-
Unsupervised Topic Segmentation of Meetings with BERT Embeddings 24 Jun 2021 · 2 repositories · arXiv:2106.12978
-
Video Swin Transformer 24 Jun 2021 · 15 repositories · arXiv:2106.13230Syntology official (archive's flag): 3 ran · 19 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 13 unverified (of 32 harvested samples) · 7 pointer-only (licence)
-
Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model 24 Jun 2021 · 0 repositories · arXiv:2106.15332
-
You are AllSet: A Multiset Function Framework for Hypergraph Neural Networks 24 Jun 2021 · 1 repository · arXiv:2106.13264Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization 23 Jun 2021 · 2 repositories · arXiv:2106.12672Syntology community repositories only · 7 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
Classifying Textual Data with Pre-trained Vision Models through Transfer Learning and Data Transformations 23 Jun 2021 · 1 repository · arXiv:2106.12479
-
IA-RED²: Interpretability-Aware Redundancy Reduction for Vision Transformers 23 Jun 2021 · 0 repositories · arXiv:2106.12620
-
Instance-based Vision Transformer for Subtyping of Papillary Renal Cell Carcinoma in Histopathological Image 23 Jun 2021 · 1 repository · arXiv:2106.12265
-
Extractive Explanations for Interpretable Text Ranking 23 Jun 2021 · 1 repository · arXiv:2106.12460
-
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding 23 Jun 2021 · 0 repositories · arXiv:2106.12566
-
Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images 23 Jun 2021 · 1 repository · arXiv:2106.12413
-
A Case Study in Bootstrapping Ontology Graphs from Textbooks 22 Jun 2021 · 0 repositories
-
A Comprehensive Comparison of Pre-training Language Models 22 Jun 2021 · 2 repositories · arXiv:2106.11483
-
BARTScore: Evaluating Generated Text as Text Generation 22 Jun 2021 · 3 repositories · arXiv:2106.11520
-
Combining Analogy with Language Models for Knowledge Extraction 22 Jun 2021 · 1 repository
-
Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering 22 Jun 2021 · 2 repositories · arXiv:2106.11517
-
LV-BERT: Exploiting Layer Variety for BERT 22 Jun 2021 · 1 repository · arXiv:2106.11740
-
One-shot to Weakly-Supervised Relation Classification using Language Models 22 Jun 2021 · 1 repository
-
P2T: Pyramid Pooling Transformer for Scene Understanding 22 Jun 2021 · 4 repositories · arXiv:2106.12011
-
Revisiting Deep Learning Models for Tabular Data 22 Jun 2021 · 11 repositories · arXiv:2106.11959Syntology official (archive's flag): 10 ran · 18 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 22 harvested samples) · 1 pointer-only (licence)
-
Ad Text Classification with Transformer-Based Natural Language Processing Methods 21 Jun 2021 · 0 repositories · arXiv:2106.10899
-
Deep Learning Models in Detection of Dietary Supplement Adverse Event Signals from Twitter 21 Jun 2021 · 0 repositories · arXiv:2106.11403
-
Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records 21 Jun 2021 · 0 repositories · arXiv:2106.11360
-
Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification 21 Jun 2021 · 1 repository · arXiv:2106.11197
-
MODETR: Moving Object Detection with Transformers 21 Jun 2021 · 0 repositories · arXiv:2106.11422
-
Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval 21 Jun 2021 · 3 repositories · arXiv:2106.11251Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning 21 Jun 2021 · 0 repositories · arXiv:2106.10936
-
Context-Aware Legal Citation Recommendation using Deep Learning 20 Jun 2021 · 1 repository · arXiv:2106.10776
-
CPM-2: Large-scale Cost-effective Pre-trained Language Models 20 Jun 2021 · 2 repositories · arXiv:2106.10715
-
Solution for Large-scale Long-tailed Recognition with Noisy Labels 20 Jun 2021 · 1 repository · arXiv:2106.10683
-
Adaptive Image Transformer for One-Shot Object Detection 19 Jun 2021 · 0 repositories
-
Clusformer: A Transformer Based Clustering Approach to Unsupervised Large-Scale Face and Visual Landmark Recognition 19 Jun 2021 · 1 repository
-
Exploring Vision Transformers for Fine-grained Classification 19 Jun 2021 · 1 repository · arXiv:2106.10587
-
Gaussian Context Transformer 19 Jun 2021 · 0 repositories
-
Hybrid approach to detecting symptoms of depression in social media entries 19 Jun 2021 · 0 repositories · arXiv:2106.10485
-
Improving Compositional Generalization in Classification Tasks via Structure Annotations 19 Jun 2021 · 0 repositories · arXiv:2106.10434
-
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs 19 Jun 2021 · 1 repository · arXiv:2106.10502
-
Pareidolia Face Reenactment 19 Jun 2021 · 0 repositories
-
Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos 19 Jun 2021 · 1 repository
-
RSTNet: Captioning With Adaptive Attention on Visual and Non-Visual Words 19 Jun 2021 · 1 repository
-
VLN BERT: A Recurrent Vision-and-Language BERT for Navigation 19 Jun 2021 · 0 repositories
-
All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers 18 Jun 2021 · 1 repository · arXiv:2106.10153
-
Anomaly Detection in Dynamic Graphs via Transformer 18 Jun 2021 · 1 repository · arXiv:2106.09876Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models 18 Jun 2021 · 6 repositories · arXiv:2106.10199Syntology community repositories only · 4 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 13 harvested samples)