Methods › General › Attention Modules › Multi-Head Attention › Papers, page 113

Multi-Head Attention

Papers archive 2025-07-28

archive papers tagged: 24,855 · with a code link: 11,214 · where Syntology ran a sample: 3,454 (2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,454 of 24,855 tagged: 2,916 with a run with no instrument failure, 538 where every run was a failure of Syntology's instrument)

Page 113 of 249: papers 11,201 to 11,300 of 24,855, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Procedural Text Mining with Large Language Models
  5 Oct 2023 · 1 repository · arXiv:2310.03376
• Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domain
  5 Oct 2023 · 1 repository · arXiv:2310.03328
• RTDK-BO: High Dimensional Bayesian Optimization with Reinforced Transformer Deep kernels
  5 Oct 2023 · 0 repositories · arXiv:2310.03912
• SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks
  5 Oct 2023 · 1 repository · arXiv:2310.03684
• Toward a Foundation Model for Time Series Data
  5 Oct 2023 · 0 repositories · arXiv:2310.03916
• Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language
  5 Oct 2023 · 0 repositories · arXiv:2310.04460
• Visual inspection for illicit items in X-ray images using Deep Learning
  5 Oct 2023 · 0 repositories · arXiv:2310.03658
• A Study of Quantisation-aware Training on Time Series Transformer Models for Resource-constrained FPGAs
  4 Oct 2023 · 0 repositories · arXiv:2310.02654
• A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
  4 Oct 2023 · 0 repositories · arXiv:2310.12321
• Can Language Models Employ the Socratic Method? Experiments with Code Debugging
  4 Oct 2023 · 1 repository · arXiv:2310.03210
• CITING: Large Language Models Create Curriculum for Instruction Tuning
  4 Oct 2023 · 0 repositories · arXiv:2310.02527
• COVID-19 South African Vaccine Hesitancy Models Show Boost in Performance Upon Fine-Tuning on M-pox Tweets
  4 Oct 2023 · 0 repositories · arXiv:2310.04453
• Decision ConvFormer: Local Filtering in MetaFormer is Sufficient for Decision Making
  4 Oct 2023 · 0 repositories · arXiv:2310.03022
• Delving into CLIP latent space for Video Anomaly Recognition
  4 Oct 2023 · 1 repository · arXiv:2310.02835
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• DQ-LoRe: Dual Queries with Low Rank Approximation Re-ranking for In-Context Learning
  4 Oct 2023 · 1 repository · arXiv:2310.02954
  Syntology official (archive's flag): 2 ran · 5 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 3 pointer-only (licence)
• GET: Group Event Transformer for Event-Based Vision
  4 Oct 2023 · 2 repositories · arXiv:2310.02642
  Syntology official (archive's flag): 8 ran · 8 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)
• GPT-4 as an interface between researchers and computational software: improving usability and reproducibility
  4 Oct 2023 · 0 repositories · arXiv:2310.11458
• How FaR Are Large Language Models From Agents with Theory-of-Mind?
  4 Oct 2023 · 1 repository · arXiv:2310.03051
• Improving Drumming Robot Via Attention Transformer Network
  4 Oct 2023 · 0 repositories · arXiv:2310.02565
• ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer
  4 Oct 2023 · 1 repository · arXiv:2310.02674
• Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning
  4 Oct 2023 · 1 repository · arXiv:2310.03094
• MedPrompt: Cross-Modal Prompting for Multi-Task Medical Image Translation
  4 Oct 2023 · 0 repositories · arXiv:2310.02663
• Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture
  4 Oct 2023 · 1 repository · arXiv:2310.03052
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (of 10 harvested samples)
• Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation
  4 Oct 2023 · 0 repositories · arXiv:2310.04456
• Multimodal Question Answering for Unified Information Extraction
  4 Oct 2023 · 1 repository · arXiv:2310.03017
• MUNCH: Modelling Unique 'N Controllable Heads
  4 Oct 2023 · 0 repositories · arXiv:2310.02753
• Neural architecture impact on identifying temporally extended Reinforcement Learning tasks
  4 Oct 2023 · 0 repositories · arXiv:2310.03161
• NOLA: Compressing LoRA using Linear Combination of Random Basis
  4 Oct 2023 · 1 repository · arXiv:2310.02556
  Syntology official (archive's flag): 5 ran · 5 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Out-of-Distribution Detection by Leveraging Between-Layer Transformation Smoothness
  4 Oct 2023 · 1 repository · arXiv:2310.02832
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Reinforcement Learning-based Mixture of Vision Transformers for Video Violence Recognition
  4 Oct 2023 · 0 repositories · arXiv:2310.03108
• Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference
  4 Oct 2023 · 2 repositories · arXiv:2310.03184
  Syntology official (archive's flag): 7 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 20 harvested samples)
• Retrieval meets Long Context Large Language Models
  4 Oct 2023 · 0 repositories · arXiv:2310.03025
• Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models
  4 Oct 2023 · 0 repositories · arXiv:2310.03182
• scHyena: Foundation Model for Full-Length Single-Cell RNA-Seq Analysis in Brain
  4 Oct 2023 · 0 repositories · arXiv:2310.02713
• SlowFormer: Universal Adversarial Patch for Attack on Compute and Energy Efficiency of Inference Efficient Vision Transformers
  4 Oct 2023 · 1 repository · arXiv:2310.02544
• T³Bench: Benchmarking Current Progress in Text-to-3D Generation
  4 Oct 2023 · 1 repository · arXiv:2310.02977
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions
  4 Oct 2023 · 0 repositories · arXiv:2310.03016
• Benchmarking and Improving Generator-Validator Consistency of Language Models
  3 Oct 2023 · 0 repositories · arXiv:2310.01846
• Can GPT-4 Replicate Empirical Software Engineering Research?
  3 Oct 2023 · 0 repositories · arXiv:2310.01727
• Can large language models provide useful feedback on research papers? A large-scale empirical analysis
  3 Oct 2023 · 1 repository · arXiv:2310.01783
• Automatic Pair Construction for Contrastive Post-training
  3 Oct 2023 · 1 repository · arXiv:2310.02263
• De Novo Drug Design with Joint Transformers
  3 Oct 2023 · 0 repositories · arXiv:2310.02066
• EcoAssistant: Using LLM Assistant More Affordably and Accurately
  3 Oct 2023 · 1 repository · arXiv:2310.03046
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Editing Personality for Large Language Models
  3 Oct 2023 · 1 repository · arXiv:2310.02168
• HallE-Control: Controlling Object Hallucination in Large Multimodal Models
  3 Oct 2023 · 2 repositories · arXiv:2310.01779
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• Harnessing Pre-Trained Sentence Transformers for Offensive Language Detection in Indian Languages
  3 Oct 2023 · 0 repositories · arXiv:2310.02249
• Instances Need More Care: Rewriting Prompts for Instances with LLMs in the Loop Yields Better Zero-Shot Performance
  3 Oct 2023 · 1 repository · arXiv:2310.02107
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Investigating Large Language Models' Perception of Emotion Using Appraisal Theory
  3 Oct 2023 · 0 repositories · arXiv:2310.04450
• Low-Resource Languages Jailbreak GPT-4
  3 Oct 2023 · 0 repositories · arXiv:2310.02446
• Probabilistically Rewired Message-Passing Neural Networks
  3 Oct 2023 · 1 repository · arXiv:2310.02156
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
• ProtoNER: Few shot Incremental Learning for Named Entity Recognition using Prototypical Networks
  3 Oct 2023 · 0 repositories · arXiv:2310.02372
• Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation
  3 Oct 2023 · 0 repositories · arXiv:2310.02368
• ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers
  3 Oct 2023 · 0 repositories · arXiv:2310.02489
• SelectFormer: Private and Practical Data Selection for Transformers
  3 Oct 2023 · 0 repositories · arXiv:2310.02373
• Selective Feature Adapter for Dense Vision Transformers
  3 Oct 2023 · 0 repositories · arXiv:2310.01843
• Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
  3 Oct 2023 · 1 repository · arXiv:2310.02304
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
• The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers
  3 Oct 2023 · 0 repositories · arXiv:2310.02041
• How Physics and Background Attributes Impact Video Transformers in Robotic Manipulation: A Case Study on Planar Pushing
  3 Oct 2023 · 0 repositories · arXiv:2310.02044
• What's Next in Affective Modeling? Large Language Models
  3 Oct 2023 · 0 repositories · arXiv:2310.18322
• Efficient Remote Sensing Segmentation With Generative Adversarial Transformer
  2 Oct 2023 · 0 repositories · arXiv:2310.01292
• Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing
  2 Oct 2023 · 1 repository · arXiv:2310.01180
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
• GPT-Driver: Learning to Drive with GPT
  2 Oct 2023 · 1 repository · arXiv:2310.01415
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Improving Dialogue Management: Quality Datasets vs Models
  2 Oct 2023 · 1 repository · arXiv:2310.01339
• Label Supervised LLaMA Finetuning
  2 Oct 2023 · 2 repositories · arXiv:2310.01208
• Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectives
  2 Oct 2023 · 1 repository · arXiv:2310.01152
• Linear attention is (maybe) all you need (to understand transformer optimization)
  2 Oct 2023 · 1 repository · arXiv:2310.01082
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examples
  2 Oct 2023 · 1 repository · arXiv:2310.01469
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
• LoFT: Local Proxy Fine-tuning For Improving Transferability Of Adversarial Attacks Against Large Language Model
  2 Oct 2023 · 0 repositories · arXiv:2310.04445
• Making LLaMA SEE and Draw with SEED Tokenizer
  2 Oct 2023 · 1 repository · arXiv:2310.01218
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)
• Syllable-level lyrics generation from melody exploiting character-level language model
  2 Oct 2023 · 0 repositories · arXiv:2310.00863
• Modality-aware Transformer for Financial Time series Forecasting
  2 Oct 2023 · 0 repositories · arXiv:2310.01232
• Natural Language Models for Data Visualization Utilizing nvBench Dataset
  2 Oct 2023 · 0 repositories · arXiv:2310.00832
• PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels
  2 Oct 2023 · 0 repositories · arXiv:2310.01655
• Revisiting Mobility Modeling with Graph: A Graph Transformer Model for Next Point-of-Interest Recommendation
  2 Oct 2023 · 1 repository · arXiv:2310.01224
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• SeisT: A foundational deep learning model for earthquake monitoring tasks
  2 Oct 2023 · 1 repository · arXiv:2310.01037
• Self-distilled Masked Attention guided masked image modeling with noise Regularized Teacher (SMART) for medical image analysis
  2 Oct 2023 · 0 repositories · arXiv:2310.01209
• Target-Aware Contextual Political Bias Detection in News
  2 Oct 2023 · 0 repositories · arXiv:2310.01138
• Probing the Multi-turn Planning Capabilities of LLMs via 20 Question Games
  2 Oct 2023 · 1 repository · arXiv:2310.01468
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• TRAM: Benchmarking Temporal Reasoning for Large Language Models
  2 Oct 2023 · 1 repository · arXiv:2310.00835
• Transformers are efficient hierarchical chemical graph learners
  2 Oct 2023 · 1 repository · arXiv:2310.01704
• UltraFeedback: Boosting Language Models with Scaled AI Feedback
  2 Oct 2023 · 4 repositories · arXiv:2310.01377
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
• Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench
  2 Oct 2023 · 1 repository · arXiv:2310.01386
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• A Comparative Study of Training Objectives for Clarification Facet Generation
  1 Oct 2023 · 1 repository · arXiv:2310.00703
• Adapting Vision Foundation Models for Plant Phenotyping
  1 Oct 2023 · 0 repositories
• Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  1 Oct 2023 · 1 repository · arXiv:2310.00754
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 8 pointer-only (licence)
• BooookScore: A systematic exploration of book-length summarization in the era of LLMs
  1 Oct 2023 · 2 repositories · arXiv:2310.00785
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• SIP: Injecting a Structural Inductive Bias into a Seq2Seq Model by Simulation
  1 Oct 2023 · 1 repository · arXiv:2310.00796
• JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention
  1 Oct 2023 · 1 repository · arXiv:2310.00535
  Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecasting
  1 Oct 2023 · 2 repositories · arXiv:2310.00655
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)
• Pre-training with Synthetic Data Helps Offline Reinforcement Learning
  1 Oct 2023 · 1 repository · arXiv:2310.00771
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
• RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models
  1 Oct 2023 · 2 repositories · arXiv:2310.00746
• Sparse Backpropagation for MoE Training
  1 Oct 2023 · 0 repositories · arXiv:2310.00811
• Testing the Limits of Unified Sequence to Sequence LLM Pretraining on Diverse Table Data Tasks
  1 Oct 2023 · 0 repositories · arXiv:2310.00789
• TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks
  1 Oct 2023 · 1 repository · arXiv:2310.00752
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
• AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ
  30 Sep 2023 · 1 repository · arXiv:2310.00367
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
• Gaze-Driven Sentence Simplification for Language Learners: Enhancing Comprehension and Readability
  30 Sep 2023 · 0 repositories · arXiv:2310.00355
• Graph Neural Architecture Search with GPT-4
  30 Sep 2023 · 0 repositories · arXiv:2310.01436
• Investigating the Efficacy of Large Language Models in Reflective Assessment Methods through Chain of Thoughts Prompting
  30 Sep 2023 · 0 repositories · arXiv:2310.00272
• ValueDCG: Measuring Comprehensive Human Value Understanding Ability of Language Models
  30 Sep 2023 · 1 repository · arXiv:2310.00378
• MVC: A Multi-Task Vision Transformer Network for COVID-19 Diagnosis from Chest X-ray Images
  30 Sep 2023 · 0 repositories · arXiv:2310.00418