Methods › General › Attention Mechanisms › Attention › Papers, page 175
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 175 of 316: papers 17,401 to 17,500 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
An Ensemble Method Based on the Combination of Transformers with Convolutional Neural Networks to Detect Artificially Generated Text 26 Oct 2023 · 0 repositories · arXiv:2310.17312
-
Arabic Fine-Grained Entity Recognition 26 Oct 2023 · 0 repositories · arXiv:2310.17333
-
BERT-PIN: A BERT-based Framework for Recovering Missing Data Segments in Time-series Load Profiles 26 Oct 2023 · 0 repositories · arXiv:2310.17742
-
Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuning 26 Oct 2023 · 0 repositories · arXiv:2310.17177
-
Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages 26 Oct 2023 · 0 repositories · arXiv:2310.17526
-
Can LLMs Grade Short-Answer Reading Comprehension Questions : An Empirical Study with a Novel Dataset 26 Oct 2023 · 0 repositories · arXiv:2310.18373
-
Codebook Features: Sparse and Discrete Interpretability for Neural Networks 26 Oct 2023 · 1 repository · arXiv:2310.17230Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples)
-
CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agents 26 Oct 2023 · 1 repository · arXiv:2310.17512Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples)
-
Cultural Adaptation of Recipes 26 Oct 2023 · 0 repositories · arXiv:2310.17353
-
FedPEAT: Convergence of Federated Learning, Parameter-Efficient Fine Tuning, and Emulator Assisted Tuning for Artificial Intelligence Foundation Models with Mobile Edge Computing 26 Oct 2023 · 0 repositories · arXiv:2310.17491
-
From Transcripts to Insights: Uncovering Corporate Risks Using Generative AI 26 Oct 2023 · 0 repositories · arXiv:2310.17721
-
Harnessing GPT-3.5-turbo for Rhetorical Role Prediction in Legal Cases 26 Oct 2023 · 0 repositories · arXiv:2310.17413
-
In-Context Learning Dynamics with Random Binary Sequences 26 Oct 2023 · 1 repository · arXiv:2310.17639Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Is Explanation the Cure? Misinformation Mitigation in the Short Term and Long Term 26 Oct 2023 · 0 repositories · arXiv:2310.17711
-
Learning to Abstract with Nonparametric Variational Information Bottleneck 26 Oct 2023 · 2 repositories · arXiv:2310.17284Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
LightLM: A Lightweight Deep and Narrow Language Model for Generative Recommendation 26 Oct 2023 · 1 repository · arXiv:2310.17488Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 1 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
DecoderTracker: Decoder-Only Method for Multiple-Object Tracking 26 Oct 2023 · 0 repositories · arXiv:2310.17170
-
Privacy-preserving Representation Learning for Speech Understanding 26 Oct 2023 · 0 repositories · arXiv:2310.17194
-
Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models 26 Oct 2023 · 0 repositories · arXiv:2310.17567
-
Sliceformer: Make Multi-head Attention as Simple as Sorting in Discriminative Tasks 26 Oct 2023 · 1 repository · arXiv:2310.17683
-
StyleBART: Decorate Pretrained Model with Style Adapters for Unsupervised Stylistic Headline Generation 26 Oct 2023 · 1 repository · arXiv:2310.17743
-
The Expressive Power of Low-Rank Adaptation 26 Oct 2023 · 1 repository · arXiv:2310.17513Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP 26 Oct 2023 · 1 repository · arXiv:2310.17644
-
Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression 26 Oct 2023 · 1 repository · arXiv:2310.17086Syntology official: no sample here; runs from other or unrecorded repositories · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
"You Are An Expert Linguistic Annotator": Limits of LLMs as Analyzers of Abstract Meaning Representation 26 Oct 2023 · 0 repositories · arXiv:2310.17793
-
ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Training Quantization Framework for W8A8 Transformers 26 Oct 2023 · 0 repositories · arXiv:2310.17723
-
Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models 25 Oct 2023 · 0 repositories · arXiv:2310.16343
-
A No-Reference Quality Assessment Method for Digital Human Head 25 Oct 2023 · 0 repositories · arXiv:2310.16732
-
An Early Evaluation of GPT-4V(ision) 25 Oct 2023 · 1 repository · arXiv:2310.16534
-
BabyStories: Can Reinforcement Learning Teach Baby Language Models to Write Better Stories? 25 Oct 2023 · 1 repository · arXiv:2310.16681Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errors 25 Oct 2023 · 2 repositories · arXiv:2310.16609
-
BOOST: Harnessing Black-Box Control to Boost Commonsense in LMs' Generation 25 Oct 2023 · 0 repositories · arXiv:2310.17054
-
Can GPT models Follow Human Summarization Guidelines? Evaluating ChatGPT and GPT-4 for Dialogue Summarization 25 Oct 2023 · 0 repositories · arXiv:2310.16810
-
CLEX: Continuous Length Extrapolation for Large Language Models 25 Oct 2023 · 1 repository · arXiv:2310.16450Syntology official (archive's flag): 9 ran · 9 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
Decoding Stumpers: Large Language Models vs. Human Problem-Solvers 25 Oct 2023 · 0 repositories · arXiv:2310.16411
-
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution 25 Oct 2023 · 4 repositories · arXiv:2310.16834Syntology official (archive's flag): 16 ran · 16 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 0 violated, 13 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples) · 15 pointer-only (licence)
-
Enhancing Document Information Analysis with Multi-Task Pre-training: A Robust Approach for Information Extraction in Visually-Rich Documents 25 Oct 2023 · 0 repositories · arXiv:2310.16527
-
GraFT: Gradual Fusion Transformer for Multimodal Re-Identification 25 Oct 2023 · 0 repositories · arXiv:2310.16856
-
How well can machine-generated texts be identified and can language models be trained to avoid identification? 25 Oct 2023 · 0 repositories · arXiv:2310.16992
-
Is ChatGPT a Good Multi-Party Conversation Solver? 25 Oct 2023 · 1 repository · arXiv:2310.16301
-
LLM-FP4: 4-Bit Floating-Point Quantized Transformers 25 Oct 2023 · 1 repository · arXiv:2310.16836Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 3 harvested samples)
-
LLM Performance Predictors are good initializers for Architecture Search 25 Oct 2023 · 1 repository · arXiv:2310.16712Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
𝕍𝔻-𝔾ℝ: Boosting 𝕍isual 𝔻ialog with Cascaded Spatial-Temporal Multi-Modal 𝔾ℝaphs 25 Oct 2023 · 0 repositories · arXiv:2310.16590
-
Modality-Agnostic Self-Supervised Learning with Meta-Learned Masked Auto-Encoder 25 Oct 2023 · 1 repository · arXiv:2310.16318Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Muslim-Violence Bias Persists in Debiased GPT Models 25 Oct 2023 · 0 repositories · arXiv:2310.18368
-
netFound: Foundation Model for Network Security 25 Oct 2023 · 1 repository · arXiv:2310.17025
-
OccuQuest: Mitigating Occupational Bias for Inclusive Large Language Models 25 Oct 2023 · 1 repository · arXiv:2310.16517
-
R³ Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context 25 Oct 2023 · 0 repositories · arXiv:2310.16535
-
RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Models 25 Oct 2023 · 0 repositories · arXiv:2310.16340
-
Prompt-Driven Building Footprint Extraction in Aerial Images with Offset-Building Model 25 Oct 2023 · 0 repositories · arXiv:2310.16717
-
RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs 25 Oct 2023 · 1 repository · arXiv:2310.16355Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 17 harvested samples)
-
SMURF-THP: Score Matching-based UnceRtainty quantiFication for Transformer Hawkes Process 25 Oct 2023 · 1 repository · arXiv:2310.16336
-
SuperHF: Supervised Iterative Learning from Human Feedback 25 Oct 2023 · 1 repository · arXiv:2310.16763Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer 25 Oct 2023 · 0 repositories · arXiv:2310.16279
-
URL-BERT: Training Webpage Representations via Social Media Engagements 25 Oct 2023 · 0 repositories · arXiv:2310.16303
-
Using GPT-4 to Augment Unbalanced Data for Automatic Scoring 25 Oct 2023 · 0 repositories · arXiv:2310.18365
-
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models 24 Oct 2023 · 0 repositories · arXiv:2310.18358
-
A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing 24 Oct 2023 · 0 repositories · arXiv:2310.16142
-
AI-enhanced Auto-correction of Programming Exercises: How Effective is GPT-3.5? 24 Oct 2023 · 0 repositories · arXiv:2311.10737
-
Background Summarization of Event Timelines 24 Oct 2023 · 1 repository · arXiv:2310.16197
-
Confounder Balancing in Adversarial Domain Adaptation for Pre-Trained Large Models Fine-Tuning 24 Oct 2023 · 0 repositories · arXiv:2310.16062
-
Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection 24 Oct 2023 · 0 repositories · arXiv:2310.15955
-
Dissecting In-Context Learning of Translations in GPTs 24 Oct 2023 · 0 repositories · arXiv:2310.15987
-
Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models 24 Oct 2023 · 1 repository · arXiv:2310.15648
-
Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation 24 Oct 2023 · 1 repository · arXiv:2310.15515
-
Learning-based Scheduling for Information Accuracy and Freshness in Wireless Networks 24 Oct 2023 · 0 repositories · arXiv:2310.15705
-
Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones? 24 Oct 2023 · 1 repository · arXiv:2310.15758Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Mixture of Tokens: Continuous MoE through Cross-Example Aggregation 24 Oct 2023 · 1 repository · arXiv:2310.15961
-
MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning 24 Oct 2023 · 3 repositories · arXiv:2310.16049Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notes 24 Oct 2023 · 1 repository · arXiv:2310.15959
-
Octopus: A Multitask Model and Toolkit for Arabic Natural Language Generation 24 Oct 2023 · 0 repositories · arXiv:2310.16127
-
Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions 24 Oct 2023 · 1 repository · arXiv:2310.16076Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning 24 Oct 2023 · 2 repositories · arXiv:2310.15719Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks 24 Oct 2023 · 1 repository · arXiv:2310.15469
-
TRAMS: Training-free Memory Selection for Long-range Language Modeling 24 Oct 2023 · 1 repository · arXiv:2310.15494Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
UI Layout Generation with LLMs Guided by UI Grammar 24 Oct 2023 · 0 repositories · arXiv:2310.15455
-
What Algorithms can Transformers Learn? A Study in Length Generalization 24 Oct 2023 · 0 repositories · arXiv:2310.16028
-
What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations 24 Oct 2023 · 0 repositories · arXiv:2310.15431
-
AlpaCare:Instruction-tuned Large Language Models for Medical Application 23 Oct 2023 · 1 repository · arXiv:2310.14558Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic 23 Oct 2023 · 0 repositories · arXiv:2310.14819
-
Attention-Enhancing Backdoor Attacks Against BERT-based Models 23 Oct 2023 · 0 repositories · arXiv:2310.14480
-
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation 23 Oct 2023 · 0 repositories · arXiv:2310.15123
-
Calibration of Time-Series Forecasting: Detecting and Adapting Context-Driven Distribution Shift 23 Oct 2023 · 2 repositories · arXiv:2310.14838Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Causal Inference Using LLM-Guided Discovery 23 Oct 2023 · 0 repositories · arXiv:2310.15117
-
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models 23 Oct 2023 · 0 repositories · arXiv:2310.15021
-
Evaluating Spatial Understanding of Large Language Models 23 Oct 2023 · 1 repository · arXiv:2310.14540Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
Evaluating the Knowledge Base Completion Potential of GPT 23 Oct 2023 · 0 repositories · arXiv:2310.14771
-
Exploring the Boundaries of GPT-4 in Radiology 23 Oct 2023 · 0 repositories · arXiv:2310.14573
-
Generative Pre-trained Transformer for Vietnamese Community-based COVID-19 Question Answering 23 Oct 2023 · 0 repositories · arXiv:2310.14602
-
GPT-4 as an Effective Zero-Shot Evaluator for Scientific Figure Captions 23 Oct 2023 · 0 repositories · arXiv:2310.15405
-
Hallucination Detection for Grounded Instruction Generation 23 Oct 2023 · 0 repositories · arXiv:2310.15319
-
Health Disparities through Generative AI Models: A Comparison Study Using A Domain Specific large language model 23 Oct 2023 · 0 repositories · arXiv:2310.18355
-
InstructExcel: A Benchmark for Natural Language Instruction in Excel 23 Oct 2023 · 0 repositories · arXiv:2310.14495
-
Language Models Hallucinate, but May Excel at Fact Verification 23 Oct 2023 · 1 repository · arXiv:2310.14564Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Large Language Models can Share Images, Too! 23 Oct 2023 · 2 repositories · arXiv:2310.14804
-
Leveraging Deep Learning for Abstractive Code Summarization of Unofficial Documentation 23 Oct 2023 · 0 repositories · arXiv:2310.15015
-
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers 23 Oct 2023 · 1 repository · arXiv:2310.15164Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysis 23 Oct 2023 · 1 repository · arXiv:2310.15100Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Location-Aware Visual Question Generation with Lightweight Models 23 Oct 2023 · 1 repository · arXiv:2310.15129
-
Non-autoregressive Streaming Transformer for Simultaneous Translation 23 Oct 2023 · 1 repository · arXiv:2310.14883Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)