Methods › General › Attention Mechanisms › Attention › Papers, page 218
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 218 of 316: papers 21,701 to 21,800 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
PanoViT: Vision Transformer for Room Layout Estimation from a Single Panoramic Image 23 Dec 2022 · 0 repositories · arXiv:2212.12156
-
Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times? 23 Dec 2022 · 0 repositories · arXiv:2212.12131
-
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT 22 Dec 2022 · 0 repositories · arXiv:2212.11456
-
Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models 22 Dec 2022 · 0 repositories · arXiv:2212.12067
-
Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise 22 Dec 2022 · 1 repository · arXiv:2212.11685Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments 22 Dec 2022 · 1 repository · arXiv:2212.11922
-
When are Lemons Purple? The Concept Association Bias of Vision-Language Models 22 Dec 2022 · 0 repositories · arXiv:2212.12043
-
Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering 21 Dec 2022 · 1 repository · arXiv:2212.10696
-
Automatic Emotion Modelling in Written Stories 21 Dec 2022 · 1 repository · arXiv:2212.11382
-
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval 21 Dec 2022 · 1 repository · arXiv:2212.10726
-
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? 21 Dec 2022 · 1 repository · arXiv:2212.10879
-
DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation 21 Dec 2022 · 1 repository · arXiv:2212.11677
-
Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal 21 Dec 2022 · 1 repository · arXiv:2212.11185Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 8 pointer-only (licence)
-
Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation 21 Dec 2022 · 0 repositories · arXiv:2212.10724
-
JASMINE: Arabic GPT Models for Few-Shot Learning 21 Dec 2022 · 0 repositories · arXiv:2212.10755
-
KL Regularized Normalization Framework for Low Resource Tasks 21 Dec 2022 · 0 repositories · arXiv:2212.11275
-
SLGTformer: An Attention-Based Approach to Sign Language Recognition 21 Dec 2022 · 1 repository · arXiv:2212.10746
-
Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction 21 Dec 2022 · 0 repositories · arXiv:2212.10728
-
Text classification in shipping industry using unsupervised models and Transformer based supervised models 21 Dec 2022 · 0 repositories · arXiv:2212.12407
-
Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks 21 Dec 2022 · 0 repositories · arXiv:2212.10774
-
Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models 21 Dec 2022 · 1 repository · arXiv:2212.10769
-
A Length-Extrapolatable Transformer 20 Dec 2022 · 5 repositories · arXiv:2212.10554Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
A Twitter BERT Approach for Offensive Language Detection in Marathi 20 Dec 2022 · 0 repositories · arXiv:2212.10039
-
ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models 20 Dec 2022 · 1 repository · arXiv:2212.10474Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Unified Framework for Histopathology Image Augmentation and Classification via Generative Models 20 Dec 2022 · 0 repositories · arXiv:2212.09977
-
Controllable Text Generation with Language Constraints 20 Dec 2022 · 0 repositories · arXiv:2212.10466
-
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning 20 Dec 2022 · 0 repositories · arXiv:2212.10240
-
Do language models have coherent mental models of everyday things? 20 Dec 2022 · 1 repository · arXiv:2212.10029Syntology official: harvested, nothing ran · 0 ran · 5 unverified (of 5 harvested samples)
-
DocAsRef: An Empirical Study on Repurposing Reference-Based Summary Quality Metrics Reference-Freely 20 Dec 2022 · 1 repository · arXiv:2212.10013
-
EIT: Enhanced Interactive Transformer 20 Dec 2022 · 2 repositories · arXiv:2212.10197
-
Future Sight: Dynamic Story Generation with Large Pretrained Language Models 20 Dec 2022 · 0 repositories · arXiv:2212.09947
-
Generic Temporal Reasoning with Differential Analysis and Explanation 20 Dec 2022 · 0 repositories · arXiv:2212.10467
-
Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Models 20 Dec 2022 · 0 repositories · arXiv:2212.10461
-
Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning 20 Dec 2022 · 0 repositories · arXiv:2212.10087
-
Identifying and Manipulating the Personality Traits of Language Models 20 Dec 2022 · 0 repositories · arXiv:2212.10276
-
In and Out-of-Domain Text Adversarial Robustness via Label Smoothing 20 Dec 2022 · 0 repositories · arXiv:2212.10258
-
Is GPT-3 a Good Data Annotator? 20 Dec 2022 · 1 repository · arXiv:2212.10450
-
Evaluating Psychological Safety of Large Language Models 20 Dec 2022 · 0 repositories · arXiv:2212.10529
-
KronA: Parameter Efficient Tuning with Kronecker Adapter 20 Dec 2022 · 0 repositories · arXiv:2212.10650
-
Large Language Models Are Reasoning Teachers 20 Dec 2022 · 1 repository · arXiv:2212.10071Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
METEOR Guided Divergence for Video Captioning 20 Dec 2022 · 1 repository · arXiv:2212.10690
-
PairReranker: Pairwise Reranking for Natural Language Generation 20 Dec 2022 · 0 repositories · arXiv:2212.10555
-
Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters 20 Dec 2022 · 0 repositories · arXiv:2212.10448
-
Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite 20 Dec 2022 · 1 repository · arXiv:2212.10190
-
Pretraining Without Attention 20 Dec 2022 · 1 repository · arXiv:2212.10544Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis 20 Dec 2022 · 0 repositories · arXiv:2212.10356
-
T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks 20 Dec 2022 · 2 repositories · arXiv:2212.10548
-
True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-4 20 Dec 2022 · 0 repositories · arXiv:2212.10114
-
Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers 20 Dec 2022 · 1 repository · arXiv:2212.10559
-
Empowering Diffusion Models on the Embedding Space for Text Generation 19 Dec 2022 · 1 repository · arXiv:2212.09412Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 9 pointer-only (licence)
-
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? 19 Dec 2022 · 1 repository · arXiv:2212.09747
-
Emergent Analogical Reasoning in Large Language Models 19 Dec 2022 · 2 repositories · arXiv:2212.09196Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Enriching Relation Extraction with OpenIE 19 Dec 2022 · 0 repositories · arXiv:2212.09376
-
Evaluating Human-Language Model Interaction 19 Dec 2022 · 1 repository · arXiv:2212.09746
-
Large Language Models are Better Reasoners with Self-Verification 19 Dec 2022 · 1 repository · arXiv:2212.09561Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
LENS: A Learnable Evaluation Metric for Text Simplification 19 Dec 2022 · 1 repository · arXiv:2212.09739
-
Less is More: Parameter-Free Text Classification with Gzip 19 Dec 2022 · 0 repositories · arXiv:2212.09410
-
MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders 19 Dec 2022 · 0 repositories · arXiv:2212.09855
-
MIGA: A Unified Multi-task Generation Framework for Conversational Text-to-SQL 19 Dec 2022 · 0 repositories · arXiv:2212.09278
-
MIST: Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering 19 Dec 2022 · 1 repository · arXiv:2212.09522
-
Mu²SLAM: Multitask, Multilingual Speech and Language Models 19 Dec 2022 · 0 repositories · arXiv:2212.09553
-
Multilingual Sequence-to-Sequence Models for Hebrew NLP 19 Dec 2022 · 0 repositories · arXiv:2212.09682
-
Reasoning with Language Model Prompting: A Survey 19 Dec 2022 · 2 repositories · arXiv:2212.09597
-
SrTR: Self-reasoning Transformer with Visual-linguistic Knowledge for Scene Graph Generation 19 Dec 2022 · 0 repositories · arXiv:2212.09329
-
The case for 4-bit precision: k-bit Inference Scaling Laws 19 Dec 2022 · 1 repository · arXiv:2212.09720
-
Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks 19 Dec 2022 · 1 repository · arXiv:2212.09912
-
BEATs: Audio Pre-Training with Acoustic Tokenizers 18 Dec 2022 · 4 repositories · arXiv:2212.09058Syntology community repositories only · 16 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples) · 4 pointer-only (licence)
-
Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint 18 Dec 2022 · 1 repository · arXiv:2212.09062Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model 18 Dec 2022 · 1 repository · arXiv:2212.09146
-
Neural Coreference Resolution based on Reinforcement Learning 18 Dec 2022 · 0 repositories · arXiv:2212.09028
-
Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search 18 Dec 2022 · 0 repositories · arXiv:2212.09017
-
Style-Hallucinated Dual Consistency Learning: A Unified Framework for Visual Domain Generalization 18 Dec 2022 · 1 repository · arXiv:2212.09068
-
Claim Optimization in Computational Argumentation 17 Dec 2022 · 1 repository · arXiv:2212.08913
-
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis 17 Dec 2022 · 0 repositories · arXiv:2212.08888
-
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation 17 Dec 2022 · 1 repository · arXiv:2212.08853
-
Leveraging Wastewater Monitoring for COVID-19 Forecasting in the US: a Deep Learning study 17 Dec 2022 · 1 repository · arXiv:2212.08798
-
Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? 16 Dec 2022 · 4 repositories · arXiv:2212.08320
-
Convolution-enhanced Evolving Attention Networks 16 Dec 2022 · 1 repository · arXiv:2212.08330
-
Homonymy Information for English WordNet 16 Dec 2022 · 1 repository · arXiv:2212.08388
-
LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images 16 Dec 2022 · 1 repository · arXiv:2212.08490
-
LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension 16 Dec 2022 · 0 repositories · arXiv:2212.08204
-
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation 16 Dec 2022 · 0 repositories · arXiv:2212.08607
-
Plansformer: Generating Symbolic Plans using Transformers 16 Dec 2022 · 0 repositories · arXiv:2212.08681
-
POIBERT: A Transformer-based Model for the Tour Recommendation Problem 16 Dec 2022 · 0 repositories · arXiv:2212.13900
-
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks 16 Dec 2022 · 1 repository · arXiv:2212.08322Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Models 16 Dec 2022 · 0 repositories · arXiv:2212.08399
-
Rethinking Cooking State Recognition with Vision Transformers 16 Dec 2022 · 1 repository · arXiv:2212.08586
-
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA 16 Dec 2022 · 1 repository · arXiv:2212.08635
-
Teaching Small Language Models to Reason 16 Dec 2022 · 0 repositories · arXiv:2212.08410
-
Utilizing distilBert transformer model for sentiment classification of COVID-19's Persian open-text responses 16 Dec 2022 · 0 repositories · arXiv:2212.08407
-
Detecting Bone Lesions in X-Ray Under Diverse Acquisition Conditions 15 Dec 2022 · 0 repositories · arXiv:2212.07792
-
Efficient Long Sequence Modeling via State Space Augmented Transformer 15 Dec 2022 · 1 repository · arXiv:2212.08136Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking 15 Dec 2022 · 1 repository · arXiv:2212.07617Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference 15 Dec 2022 · 0 repositories · arXiv:2212.08153
-
HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving 15 Dec 2022 · 0 repositories · arXiv:2212.07729
-
CLIPPO: Image-and-Language Understanding from Pixels Only 15 Dec 2022 · 1 repository · arXiv:2212.08045
-
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation 15 Dec 2022 · 2 repositories · arXiv:2212.07981Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Scaffold-Based Multi-Objective Drug Candidate Optimization 15 Dec 2022 · 0 repositories · arXiv:2301.07175
-
Sim-to-Real Transfer for Quadrupedal Locomotion via Terrain Transformer 15 Dec 2022 · 0 repositories · arXiv:2212.07740
-
Visually-augmented pretrained language models for NLP tasks without images 15 Dec 2022 · 1 repository · arXiv:2212.07937