Methods › General › Attention Modules › Multi-Head Attention › Papers, page 168
Multi-Head Attention
Papers archive 2025-07-28
archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)
Page 168 of 249: papers 16,701 to 16,800 of 24,855, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation 30 Jun 2022 · 1 repository · arXiv:2207.00106
-
No Reason for No Supervision: Improved Generalization in Supervised Models 30 Jun 2022 · 1 repository · arXiv:2206.15369Syntology 7 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
ListBERT: Learning to Rank E-commerce products with Listwise BERT 30 Jun 2022 · 0 repositories · arXiv:2206.15198
-
PolarFormer: Multi-camera 3D Object Detection with Polar Transformer 30 Jun 2022 · 1 repository · arXiv:2206.15398Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
PVT-COV19D: Pyramid Vision Transformer for COVID-19 Diagnosis 30 Jun 2022 · 0 repositories · arXiv:2206.15069
-
Rethinking Surgical Captioning: End-to-End Window-Based MLP Transformer Using Patches 30 Jun 2022 · 1 repository · arXiv:2207.00113
-
TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Prediction 30 Jun 2022 · 0 repositories · arXiv:2207.00170
-
The Topological BERT: Transforming Attention into Topology for Natural Language Processing 30 Jun 2022 · 0 repositories · arXiv:2206.15195
-
Two-Stage Classifier for COVID-19 Misinformation Detection Using BERT: a Study on Indonesian Tweets 30 Jun 2022 · 2 repositories · arXiv:2206.15359
-
BATFormer: Towards Boundary-Aware Lightweight Transformer for Efficient Medical Image Segmentation 29 Jun 2022 · 2 repositories · arXiv:2206.14409
-
Chinese Word Sense Embedding with SememeWSD and Synonym Set 29 Jun 2022 · 2 repositories · arXiv:2206.14388
-
Deformable Graph Transformer 29 Jun 2022 · 0 repositories · arXiv:2206.14337
-
LViT: Language meets Vision Transformer in Medical Image Segmentation 29 Jun 2022 · 1 repository · arXiv:2206.14718Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Multi-Channel Vision Transformer for Epileptic Seizure Prediction 29 Jun 2022 · 0 repositories
-
On the Prediction Network Architecture in RNN-T for ASR 29 Jun 2022 · 0 repositories · arXiv:2206.14618
-
SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences 29 Jun 2022 · 0 repositories · arXiv:2206.14550
-
Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosody 29 Jun 2022 · 0 repositories · arXiv:2206.14643
-
Two-Stage COVID19 Classification Using BERT Features 29 Jun 2022 · 0 repositories · arXiv:2206.14861
-
Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detection 28 Jun 2022 · 2 repositories · arXiv:2206.13829
-
Exploring linguistic feature and model combination for speech recognition based automatic AD detection 28 Jun 2022 · 0 repositories · arXiv:2206.13758
-
Robustifying Vision Transformer without Retraining from Scratch by Test-Time Class-Conditional Feature Alignment 28 Jun 2022 · 1 repository · arXiv:2206.13951Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
ZoDIAC: Zoneout Dropout Injection Attention Calculation 28 Jun 2022 · 1 repository · arXiv:2206.14263
-
Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading 27 Jun 2022 · 0 repositories · arXiv:2206.13173
-
Kernel Attention Transformer (KAT) for Histopathology Whole Slide Image Classification 27 Jun 2022 · 1 repository · arXiv:2206.13156
-
Materials Transformers Language Models for Generative Materials Design: a benchmark study 27 Jun 2022 · 1 repository · arXiv:2206.13578
-
Prompting Decision Transformer for Few-Shot Policy Generalization 27 Jun 2022 · 0 repositories · arXiv:2206.13499
-
Multiple Instance Learning with Mixed Supervision in Gleason Grading 26 Jun 2022 · 1 repository · arXiv:2206.12798
-
On Comparison of Encoders for Attention based End to End Speech Recognition in Standalone and Rescoring Mode 26 Jun 2022 · 0 repositories · arXiv:2206.12829
-
Vision Transformer for Contrastive Clustering 26 Jun 2022 · 1 repository · arXiv:2206.12925
-
Adversarial Self-Attention for Language Understanding 25 Jun 2022 · 1 repository · arXiv:2206.12608
-
Construct a Sentence with Multiple Specified Words 25 Jun 2022 · 0 repositories · arXiv:2206.12565
-
SC-Transformer++: Structured Context Transformer for Generic Event Boundary Detection 25 Jun 2022 · 1 repository · arXiv:2206.12634
-
Self-supervised Context-aware Style Representation for Expressive Speech Synthesis 25 Jun 2022 · 0 repositories · arXiv:2206.12559
-
A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data set 24 Jun 2022 · 0 repositories · arXiv:2206.12027
-
A Test for Evaluating Performance in Human-Computer Systems 24 Jun 2022 · 0 repositories · arXiv:2206.12390
-
Bag of Tricks for Long-Tail Visual Recognition of Animal Species in Camera-Trap Images 24 Jun 2022 · 1 repository · arXiv:2206.12458
-
Capture Salient Historical Information: A Fast and Accurate Non-Autoregressive Model for Multi-turn Spoken Language Understanding 24 Jun 2022 · 0 repositories · arXiv:2206.12209
-
Confidence Score Based Conformer Speaker Adaptation for Speech Recognition 24 Jun 2022 · 0 repositories · arXiv:2206.12045
-
MVP: Multi-task Supervised Pre-training for Natural Language Generation 24 Jun 2022 · 4 repositories · arXiv:2206.12131
-
Text and author-level political inference using heterogeneous knowledge representations 24 Jun 2022 · 0 repositories · arXiv:2206.12293
-
The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation 24 Jun 2022 · 0 repositories · arXiv:2206.12035
-
Unified BERT for Few-shot Natural Language Understanding 24 Jun 2022 · 0 repositories · arXiv:2206.12094
-
Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users 24 Jun 2022 · 0 repositories · arXiv:2206.12368
-
A Disability Lens towards Biases in GPT-3 Generated Open-Ended Languages 23 Jun 2022 · 0 repositories · arXiv:2206.11993
-
BERT Rankers are Brittle: a Study using Adversarial Document Perturbations 23 Jun 2022 · 1 repository · arXiv:2206.11724
-
Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes 23 Jun 2022 · 0 repositories · arXiv:2206.11703
-
Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs 23 Jun 2022 · 4 repositories · arXiv:2206.11990Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
ICOS Protein Expression Segmentation: Can Transformer Networks Give Better Results? 23 Jun 2022 · 1 repository · arXiv:2206.11520
-
Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Space 23 Jun 2022 · 1 repository · arXiv:2206.11895Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
Revisiting Orthogonality Regularization: A Study for Convolutional Neural Networks in Image Classification 23 Jun 2022 · 1 repository
-
Set Norm and Equivariant Skip Connections: Putting the Deep in Deep Sets 23 Jun 2022 · 1 repository · arXiv:2206.11925Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Toward Clinically Assisted Colorectal Polyp Recognition via Structured Cross-modal Representation Consistency 23 Jun 2022 · 1 repository · arXiv:2206.11826
-
Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models 23 Jun 2022 · 0 repositories · arXiv:2206.11484
-
Answer Fast: Accelerating BERT on the Tensor Streaming Processor 22 Jun 2022 · 0 repositories · arXiv:2206.11062
-
Behavior Transformers: Cloning k modes with one stone 22 Jun 2022 · 2 repositories · arXiv:2206.11251Syntology official (archive's flag): 5 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples)
-
Efficient and effective training of language and graph neural network models 22 Jun 2022 · 0 repositories · arXiv:2206.10781
-
Feature Re-calibration based Multiple Instance Learning for Whole Slide Image Classification 22 Jun 2022 · 1 repository · arXiv:2206.10878
-
Generative Pretraining for Black-Box Optimization 22 Jun 2022 · 1 repository · arXiv:2206.10786Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 3 pointer-only (licence)
-
S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Driving 22 Jun 2022 · 1 repository · arXiv:2206.10902
-
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation 22 Jun 2022 · 2 repositories · arXiv:2206.10789Syntology 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 2 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles 22 Jun 2022 · 1 repository · arXiv:2206.11184
-
An Automatic and Efficient BERT Pruning for Edge AI Systems 21 Jun 2022 · 0 repositories · arXiv:2206.10461
-
CoCoPIE XGen: A Full-Stack AI-Oriented Optimizing Framework 21 Jun 2022 · 0 repositories · arXiv:2206.10620
-
ConTraNet: A single end-to-end hybrid network for EEG-based and EMG-based human machine interfaces 21 Jun 2022 · 0 repositories · arXiv:2206.10677
-
Counting Varying Density Crowds Through Density Guided Adaptive Selection CNN and Transformer Estimation 21 Jun 2022 · 0 repositories · arXiv:2206.10075
-
Derivative-Informed Neural Operator: An Efficient Framework for High-Dimensional Parametric Derivative Learning 21 Jun 2022 · 2 repositories · arXiv:2206.10745
-
EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications 21 Jun 2022 · 8 repositories · arXiv:2206.10589Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Low-Resource NLP 21 Jun 2022 · 0 repositories · arXiv:2206.10265
-
Knowledge Graph Fusion for Language Model Fine-tuning 21 Jun 2022 · 0 repositories · arXiv:2206.14574
-
One-stage Action Detection Transformer 21 Jun 2022 · 0 repositories · arXiv:2206.10080
-
Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery 21 Jun 2022 · 1 repository · arXiv:2206.10540Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
SVG Vector Font Generation for Chinese Characters with Transformer 21 Jun 2022 · 0 repositories · arXiv:2206.10329
-
TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements 21 Jun 2022 · 0 repositories · arXiv:2206.10227
-
Toward Unpaired Multi-modal Medical Image Segmentation via Learning Structured Semantic Consistency 21 Jun 2022 · 0 repositories · arXiv:2206.10571
-
Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matching 21 Jun 2022 · 2 repositories · arXiv:2206.10436Syntology community repositories only · 5 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammograms 21 Jun 2022 · 0 repositories · arXiv:2206.10096
-
Using cognitive psychology to understand GPT-3 21 Jun 2022 · 0 repositories · arXiv:2206.14576
-
Vicinity Vision Transformer 21 Jun 2022 · 1 repository · arXiv:2206.10552Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data 20 Jun 2022 · 1 repository · arXiv:2206.09591Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 6 harvested samples) · 6 pointer-only (licence)
-
Global Context Vision Transformers 20 Jun 2022 · 8 repositories · arXiv:2206.09959Syntology official (archive's flag): 12 ran · 21 ran (of which 8 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 4 where Syntology's instrument failed) · 15 unverified (of 36 harvested samples) · 15 pointer-only (licence)
-
M&M Mix: A Multimodal Multiview Transformer Ensemble 20 Jun 2022 · 0 repositories · arXiv:2206.09852
-
LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models 20 Jun 2022 · 2 repositories · arXiv:2206.09557
-
ORFD: A Dataset and Benchmark for Off-Road Freespace Detection 20 Jun 2022 · 2 repositories · arXiv:2206.09907
-
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm 19 Jun 2022 · 1 repository · arXiv:2206.09325Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Learning Multiscale Transformer Models for Sequence Generation 19 Jun 2022 · 1 repository · arXiv:2206.09337
-
Resource-Efficient Separation Transformer 19 Jun 2022 · 1 repository · arXiv:2206.09507
-
Traffic-Twitter Transformer: A Nature Language Processing-joined Framework For Network-wide Traffic Forecasting 19 Jun 2022 · 0 repositories · arXiv:2206.11078
-
Transfer Learning for Robust Low-Resource Children's Speech ASR with Transformers and Source-Filter Warping 19 Jun 2022 · 0 repositories · arXiv:2206.09396
-
Argumentative Text Generation in Economic Domain 18 Jun 2022 · 1 repository · arXiv:2206.09251
-
Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods 18 Jun 2022 · 0 repositories · arXiv:2206.09253
-
Can Language Models Capture Graph Semantics? From Graphs to Language Model and Vice-Versa 18 Jun 2022 · 0 repositories · arXiv:2206.09259
-
CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks 18 Jun 2022 · 1 repository · arXiv:2206.09059
-
Demystifying the Adversarial Robustness of Random Transformation Defenses 18 Jun 2022 · 1 repository · arXiv:2207.03574Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples)
-
Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games 18 Jun 2022 · 1 repository · arXiv:2206.09120Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
RuArg-2022: Argument Mining Evaluation 18 Jun 2022 · 0 repositories · arXiv:2206.09249
-
BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers 17 Jun 2022 · 0 repositories · arXiv:2206.08680
-
Bootstrapped Transformer for Offline Reinforcement Learning 17 Jun 2022 · 0 repositories · arXiv:2206.08569Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation 17 Jun 2022 · 2 repositories · arXiv:2206.08948Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
CtrlFormer: Learning Transferable State Representation for Visual Control via Transformer 17 Jun 2022 · 1 repository · arXiv:2206.08883Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Rectify ViT Shortcut Learning by Visual Saliency 17 Jun 2022 · 0 repositories · arXiv:2206.08567