Methods › General › Attention Modules › Multi-Head Attention › Papers, page 151

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 151 of 249: papers 15,001 to 15,100 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Swin MAE: Masked Autoencoders for Small Datasets
  28 Dec 2022 · 1 repository · arXiv:2212.13805
• Thermal Heating in ReRAM Crossbar Arrays: Challenges and Solutions
  28 Dec 2022 · 0 repositories · arXiv:2212.13707
• 1st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object Segmentation
  27 Dec 2022 · 1 repository · arXiv:2212.14679
• A Generalization of ViT/MLP-Mixer to Graphs
  27 Dec 2022 · 3 repositories · arXiv:2212.13350
  Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• A Survey on Knowledge-Enhanced Pre-trained Language Models
  27 Dec 2022 · 0 repositories · arXiv:2212.13428
• BART-IT: An Efficient Sequence-to-Sequence Model for Italian Text Summarization
  27 Dec 2022 · 1 repository
• Countering Malicious Content Moderation Evasion in Online Social Networks: Simulation and Detection of Word Camouflage
  27 Dec 2022 · 1 repository · arXiv:2212.14727
• DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation
  27 Dec 2022 · 1 repository · arXiv:2212.13504
• DeepCuts: Single-Shot Interpretability based Pruning for BERT
  27 Dec 2022 · 1 repository · arXiv:2212.13392
• Exploring Efficiency of Vision Transformers for Self-Supervised Monocular Depth Estimation
  27 Dec 2022 · 1 repository
• Exploring Transformer Backbones for Image Diffusion Models
  27 Dec 2022 · 0 repositories · arXiv:2212.14678
• TegFormer: Topic-to-Essay Generation with Good Topic Coverage and High Text Coherence
  27 Dec 2022 · 0 repositories · arXiv:2212.13456
• Using Large Language Models to Generate Engaging Captions for Data Visualizations
  27 Dec 2022 · 0 repositories · arXiv:2212.14047
• Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers
  26 Dec 2022 · 0 repositories · arXiv:2212.13196
• Transformer and GAN Based Super-Resolution Reconstruction Network for Medical Images
  26 Dec 2022 · 0 repositories · arXiv:2212.13068
• TypeFormer: Transformers for Mobile Keystroke Biometrics
  26 Dec 2022 · 1 repository · arXiv:2212.13075
• Boosting Urban Traffic Speed Prediction via Integrating Implicit Spatial Correlations
  25 Dec 2022 · 0 repositories · arXiv:2212.12932
• Hybrid Representation Learning for Cognitive Diagnosis in Late-Life Depression Over 5 Years with Structural MRI
  24 Dec 2022 · 1 repository · arXiv:2212.12810
• On Realization of Intelligent Decision-Making in the Real World: A Foundation Decision Model Perspective
  24 Dec 2022 · 1 repository · arXiv:2212.12669
• Optimizing Deep Transformers for Chinese-Thai Low-Resource Translation
  24 Dec 2022 · 0 repositories · arXiv:2212.12662
• A Close Look at Spatial Modeling: From Attention to Convolution
  23 Dec 2022 · 1 repository · arXiv:2212.12552
• AMDET: Attention based Multiple Dimensions EEG Transformer for Emotion Recognition
  23 Dec 2022 · 0 repositories · arXiv:2212.12134
• Benchmark for Uncertainty & Robustness in Self-Supervised Learning
  23 Dec 2022 · 1 repository · arXiv:2212.12411
• Detecting Objects with Context-Likelihood Graphs and Graph Refinement
  23 Dec 2022 · 0 repositories · arXiv:2212.12395
• Finetuning for Sarcasm Detection with a Pruned Dataset
  23 Dec 2022 · 1 repository · arXiv:2212.12213
• PanoViT: Vision Transformer for Room Layout Estimation from a Single Panoramic Image
  23 Dec 2022 · 0 repositories · arXiv:2212.12156
• Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?
  23 Dec 2022 · 0 repositories · arXiv:2212.12131
• CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
  22 Dec 2022 · 0 repositories · arXiv:2212.11456
• Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models
  22 Dec 2022 · 0 repositories · arXiv:2212.12067
• Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise
  22 Dec 2022 · 1 repository · arXiv:2212.11685
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments
  22 Dec 2022 · 1 repository · arXiv:2212.11922
• When are Lemons Purple? The Concept Association Bias of Vision-Language Models
  22 Dec 2022 · 0 repositories · arXiv:2212.12043
• Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering
  21 Dec 2022 · 1 repository · arXiv:2212.10696
• Automatic Emotion Modelling in Written Stories
  21 Dec 2022 · 1 repository · arXiv:2212.11382
• Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval
  21 Dec 2022 · 1 repository · arXiv:2212.10726
• Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?
  21 Dec 2022 · 1 repository · arXiv:2212.10879
• DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation
  21 Dec 2022 · 1 repository · arXiv:2212.11677
• Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal
  21 Dec 2022 · 1 repository · arXiv:2212.11185
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 8 pointer-only (licence)
• Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation
  21 Dec 2022 · 0 repositories · arXiv:2212.10724
• JASMINE: Arabic GPT Models for Few-Shot Learning
  21 Dec 2022 · 0 repositories · arXiv:2212.10755
• KL Regularized Normalization Framework for Low Resource Tasks
  21 Dec 2022 · 0 repositories · arXiv:2212.11275
• SLGTformer: An Attention-Based Approach to Sign Language Recognition
  21 Dec 2022 · 1 repository · arXiv:2212.10746
• Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction
  21 Dec 2022 · 0 repositories · arXiv:2212.10728
• Text classification in shipping industry using unsupervised models and Transformer based supervised models
  21 Dec 2022 · 0 repositories · arXiv:2212.12407
• Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks
  21 Dec 2022 · 0 repositories · arXiv:2212.10774
• Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models
  21 Dec 2022 · 1 repository · arXiv:2212.10769
• A Length-Extrapolatable Transformer
  20 Dec 2022 · 5 repositories · arXiv:2212.10554
  Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 2 pointer-only (licence)
• A Twitter BERT Approach for Offensive Language Detection in Marathi
  20 Dec 2022 · 0 repositories · arXiv:2212.10039
• ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models
  20 Dec 2022 · 1 repository · arXiv:2212.10474
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Unified Framework for Histopathology Image Augmentation and Classification via Generative Models
  20 Dec 2022 · 0 repositories · arXiv:2212.09977
• Controllable Text Generation with Language Constraints
  20 Dec 2022 · 0 repositories · arXiv:2212.10466
• Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning
  20 Dec 2022 · 0 repositories · arXiv:2212.10240
• Do language models have coherent mental models of everyday things?
  20 Dec 2022 · 1 repository · arXiv:2212.10029
  Syntology official: harvested, nothing ran · 0 ran · 5 unverified (of 5 harvested samples)
• DocAsRef: An Empirical Study on Repurposing Reference-Based Summary Quality Metrics Reference-Freely
  20 Dec 2022 · 1 repository · arXiv:2212.10013
• EIT: Enhanced Interactive Transformer
  20 Dec 2022 · 2 repositories · arXiv:2212.10197
• Future Sight: Dynamic Story Generation with Large Pretrained Language Models
  20 Dec 2022 · 0 repositories · arXiv:2212.09947
• Generic Temporal Reasoning with Differential Analysis and Explanation
  20 Dec 2022 · 0 repositories · arXiv:2212.10467
• Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Models
  20 Dec 2022 · 0 repositories · arXiv:2212.10461
• Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning
  20 Dec 2022 · 0 repositories · arXiv:2212.10087
• Identifying and Manipulating the Personality Traits of Language Models
  20 Dec 2022 · 0 repositories · arXiv:2212.10276
• In and Out-of-Domain Text Adversarial Robustness via Label Smoothing
  20 Dec 2022 · 0 repositories · arXiv:2212.10258
• Is GPT-3 a Good Data Annotator?
  20 Dec 2022 · 1 repository · arXiv:2212.10450
• Evaluating Psychological Safety of Large Language Models
  20 Dec 2022 · 0 repositories · arXiv:2212.10529
• KronA: Parameter Efficient Tuning with Kronecker Adapter
  20 Dec 2022 · 0 repositories · arXiv:2212.10650
• Large Language Models Are Reasoning Teachers
  20 Dec 2022 · 1 repository · arXiv:2212.10071
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
• METEOR Guided Divergence for Video Captioning
  20 Dec 2022 · 1 repository · arXiv:2212.10690
• PairReranker: Pairwise Reranking for Natural Language Generation
  20 Dec 2022 · 0 repositories · arXiv:2212.10555
• Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters
  20 Dec 2022 · 0 repositories · arXiv:2212.10448
• Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite
  20 Dec 2022 · 1 repository · arXiv:2212.10190
• Pretraining Without Attention
  20 Dec 2022 · 1 repository · arXiv:2212.10544
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis
  20 Dec 2022 · 0 repositories · arXiv:2212.10356
• T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks
  20 Dec 2022 · 2 repositories · arXiv:2212.10548
• True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-4
  20 Dec 2022 · 0 repositories · arXiv:2212.10114
• Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
  20 Dec 2022 · 1 repository · arXiv:2212.10559
• Empowering Diffusion Models on the Embedding Space for Text Generation
  19 Dec 2022 · 1 repository · arXiv:2212.09412
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 9 pointer-only (licence)
• Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
  19 Dec 2022 · 1 repository · arXiv:2212.09747
• Emergent Analogical Reasoning in Large Language Models
  19 Dec 2022 · 2 repositories · arXiv:2212.09196
  Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Enriching Relation Extraction with OpenIE
  19 Dec 2022 · 0 repositories · arXiv:2212.09376
• Evaluating Human-Language Model Interaction
  19 Dec 2022 · 1 repository · arXiv:2212.09746
• Large Language Models are Better Reasoners with Self-Verification
  19 Dec 2022 · 1 repository · arXiv:2212.09561
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• LENS: A Learnable Evaluation Metric for Text Simplification
  19 Dec 2022 · 1 repository · arXiv:2212.09739
• Less is More: Parameter-Free Text Classification with Gzip
  19 Dec 2022 · 0 repositories · arXiv:2212.09410
• MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders
  19 Dec 2022 · 0 repositories · arXiv:2212.09855
• MIGA: A Unified Multi-task Generation Framework for Conversational Text-to-SQL
  19 Dec 2022 · 0 repositories · arXiv:2212.09278
• MIST: Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering
  19 Dec 2022 · 1 repository · arXiv:2212.09522
• Mu²SLAM: Multitask, Multilingual Speech and Language Models
  19 Dec 2022 · 0 repositories · arXiv:2212.09553
• Multilingual Sequence-to-Sequence Models for Hebrew NLP
  19 Dec 2022 · 0 repositories · arXiv:2212.09682
• Reasoning with Language Model Prompting: A Survey
  19 Dec 2022 · 2 repositories · arXiv:2212.09597
• SrTR: Self-reasoning Transformer with Visual-linguistic Knowledge for Scene Graph Generation
  19 Dec 2022 · 0 repositories · arXiv:2212.09329
• The case for 4-bit precision: k-bit Inference Scaling Laws
  19 Dec 2022 · 1 repository · arXiv:2212.09720
• Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks
  19 Dec 2022 · 1 repository · arXiv:2212.09912
• BEATs: Audio Pre-Training with Acoustic Tokenizers
  18 Dec 2022 · 4 repositories · arXiv:2212.09058
  Syntology community repositories only · 16 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples) · 4 pointer-only (licence)
• Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint
  18 Dec 2022 · 1 repository · arXiv:2212.09062
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model
  18 Dec 2022 · 1 repository · arXiv:2212.09146
• Neural Coreference Resolution based on Reinforcement Learning
  18 Dec 2022 · 0 repositories · arXiv:2212.09028
• Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
  18 Dec 2022 · 0 repositories · arXiv:2212.09017
• Style-Hallucinated Dual Consistency Learning: A Unified Framework for Visual Domain Generalization
  18 Dec 2022 · 1 repository · arXiv:2212.09068
• Claim Optimization in Computational Argumentation
  17 Dec 2022 · 1 repository · arXiv:2212.08913
• Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis
  17 Dec 2022 · 0 repositories · arXiv:2212.08888
• Leveraging Wastewater Monitoring for COVID-19 Forecasting in the US: a Deep Learning study
  17 Dec 2022 · 1 repository · arXiv:2212.08798