Methods › General › Attention Mechanisms › Attention › Papers, page 263
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 263 of 316: papers 26,201 to 26,300 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
On Pursuit of Designing Multi-modal Transformer for Video Grounding 13 Sep 2021 · 0 repositories · arXiv:2109.06085
-
Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration 13 Sep 2021 · 2 repositories · arXiv:2109.06304Syntology official (archive's flag): 2 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework 13 Sep 2021 · 1 repository · arXiv:2109.05897Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation 13 Sep 2021 · 0 repositories · arXiv:2109.05812
-
ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis 12 Sep 2021 · 2 repositories · arXiv:2109.05488
-
Constructing Phrase-level Semantic Labels to Form Multi-Grained Supervision for Image-Text Retrieval 12 Sep 2021 · 0 repositories · arXiv:2109.05523
-
FLiText: A Faster and Lighter Semi-Supervised Text Classification with Convolution Networks 12 Sep 2021 · 1 repository · arXiv:2110.11869
-
Levenshtein Training for Word-level Quality Estimation 12 Sep 2021 · 1 repository · arXiv:2109.05611
-
PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Clouds 12 Sep 2021 · 1 repository · arXiv:2109.05566
-
Single-Read Reconstruction for DNA Data Storage Using Transformers 12 Sep 2021 · 0 repositories · arXiv:2109.05478
-
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary? 12 Sep 2021 · 2 repositories · arXiv:2109.05422
-
TEASEL: A Transformer-Based Speech-Prefixed Language Model 12 Sep 2021 · 1 repository · arXiv:2109.05522Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Adaptive network reliability analysis: Methodology and applications to power grid 11 Sep 2021 · 0 repositories · arXiv:2109.05360
-
Bornon: Bengali Image Captioning with Transformer-based Deep learning approach 11 Sep 2021 · 0 repositories · arXiv:2109.05218
-
Clinical Trial Information Extraction with BERT 11 Sep 2021 · 0 repositories · arXiv:2110.10027
-
Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems 11 Sep 2021 · 1 repository · arXiv:2109.05217
-
Multilingual Translation via Grafting Pre-trained Language Models 11 Sep 2021 · 1 repository · arXiv:2109.05256
-
TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System 11 Sep 2021 · 0 repositories · arXiv:2109.05187
-
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA 10 Sep 2021 · 1 repository · arXiv:2109.05014Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
An Exploratory Study on Long Dialogue Summarization: What Works and What's Next 10 Sep 2021 · 1 repository · arXiv:2109.04609
-
Artificial Text Detection via Examining the Topology of Attention Maps 10 Sep 2021 · 2 repositories · arXiv:2109.04825Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 8 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Block Pruning For Faster Transformers 10 Sep 2021 · 1 repository · arXiv:2109.04838
-
D-REX: Dialogue Relation Extraction with Explanations 10 Sep 2021 · 1 repository · arXiv:2109.05126
-
Enhancing Self-Disclosure In Neural Dialog Models By Candidate Re-ranking 10 Sep 2021 · 0 repositories · arXiv:2109.05090
-
FBERT: A Neural Transformer for Identifying Offensive Content 10 Sep 2021 · 0 repositories · arXiv:2109.05074
-
HELIX: Data-driven characterization of Brazilian land snails 10 Sep 2021 · 0 repositories · arXiv:2109.04903
-
How May I Help You? Using Neural Text Simplification to Improve Downstream NLP Tasks 10 Sep 2021 · 1 repository · arXiv:2109.04604
-
IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization 10 Sep 2021 · 1 repository · arXiv:2109.04607
-
Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model 10 Sep 2021 · 1 repository · arXiv:2109.04672Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT 10 Sep 2021 · 1 repository · arXiv:2109.04810Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
On the validity of pre-trained transformers for natural language processing in the software engineering domain 10 Sep 2021 · 0 repositories · arXiv:2109.04738
-
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models 10 Sep 2021 · 3 repositories · arXiv:2109.05093Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Real-time multimodal image registration with partial intraoperative point-set data 10 Sep 2021 · 0 repositories · arXiv:2109.05023
-
RoR: Read-over-Read for Long Document Machine Reading Comprehension 10 Sep 2021 · 1 repository · arXiv:2109.04780
-
Temporal Pyramid Transformer with Multimodal Interaction for Video Question Answering 10 Sep 2021 · 1 repository · arXiv:2109.04735
-
What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers 10 Sep 2021 · 2 repositories · arXiv:2109.04650Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Zero-Shot Dialogue State Tracking via Cross-Task Transfer 10 Sep 2021 · 1 repository · arXiv:2109.04655
-
A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generation 9 Sep 2021 · 1 repository · arXiv:2109.04096Syntology official (archive's flag): 18 ran · 18 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 6 where Syntology's instrument failed) · 9 unverified (of 27 harvested samples) · 5 pointer-only (licence)
-
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality 9 Sep 2021 · 1 repository · arXiv:2109.04404
-
Bag of Tricks for Optimizing Transformer Efficiency 9 Sep 2021 · 1 repository · arXiv:2109.04030
-
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation 9 Sep 2021 · 2 repositories · arXiv:2109.04588Syntology official (archive's flag): 1 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
DAN: Decentralized Attention-based Neural Network for the MinMax Multiple Traveling Salesman Problem 9 Sep 2021 · 0 repositories · arXiv:2109.04205
-
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding 9 Sep 2021 · 2 repositories · arXiv:2109.04380
-
Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection 9 Sep 2021 · 1 repository · arXiv:2109.04292
-
Generic resources are what you need: Style transfer tasks without task-specific parallel training data 9 Sep 2021 · 1 repository · arXiv:2109.04543
-
Graph-Based Decoding for Task Oriented Semantic Parsing 9 Sep 2021 · 0 repositories · arXiv:2109.04587
-
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss 9 Sep 2021 · 2 repositories · arXiv:2109.04290
-
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs 9 Sep 2021 · 1 repository · arXiv:2109.04223Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
MATE: Multi-view Attention for Table Transformer Efficiency 9 Sep 2021 · 1 repository · arXiv:2109.04312
-
Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization 9 Sep 2021 · 0 repositories · arXiv:2110.07356
-
Mining Points of Interest via Address Embeddings: An Unsupervised Approach 9 Sep 2021 · 0 repositories · arXiv:2109.04467
-
Multi-granularity Textual Adversarial Attack with Behavior Cloning 9 Sep 2021 · 1 repository · arXiv:2109.04367
-
Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems 9 Sep 2021 · 1 repository · arXiv:2109.04084Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer 9 Sep 2021 · 3 repositories · arXiv:2109.04335Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems 9 Sep 2021 · 2 repositories · arXiv:2109.04314
-
Word-Level Coreference Resolution 9 Sep 2021 · 1 repository · arXiv:2109.04127
-
Ensemble Fine-tuned mBERT for Translation Quality Estimation 8 Sep 2021 · 0 repositories · arXiv:2109.03914
-
Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP 8 Sep 2021 · 2 repositories · arXiv:2109.03777
-
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction 8 Sep 2021 · 1 repository · arXiv:2109.03659
-
NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction 8 Sep 2021 · 1 repository · arXiv:2109.03564
-
Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformers 8 Sep 2021 · 3 repositories · arXiv:2109.03814
-
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models 8 Sep 2021 · 0 repositories · arXiv:2109.03892
-
Sustainable Modular Debiasing of Language Models 8 Sep 2021 · 0 repositories · arXiv:2109.03646
-
TruthfulQA: Measuring How Models Mimic Human Falsehoods 8 Sep 2021 · 3 repositories · arXiv:2109.07958Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
What's Hidden in a One-layer Randomly Weighted Transformer? 8 Sep 2021 · 1 repository · arXiv:2109.03939
-
BERT based classification system for detecting rumours on Twitter 7 Sep 2021 · 0 repositories · arXiv:2109.02975
-
Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledge 7 Sep 2021 · 0 repositories · arXiv:2109.03004
-
FHAC at GermEval 2021: Identifying German toxic, engaging, and fact-claiming comments with ensemble learning 7 Sep 2021 · 1 repository · arXiv:2109.03094
-
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting 7 Sep 2021 · 1 repository · arXiv:2109.02974Syntology official (archive's flag): 10 ran · 10 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Hierarchical Graph Convolutional Skeleton Transformer for Action Recognition 7 Sep 2021 · 0 repositories · arXiv:2109.02860
-
How much pretraining data do language models need to learn syntax? 7 Sep 2021 · 0 repositories · arXiv:2109.03160
-
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval 7 Sep 2021 · 0 repositories · arXiv:2109.02789
-
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT 7 Sep 2021 · 0 repositories · arXiv:2109.02938
-
nnFormer: Interleaved Transformer for Volumetric Segmentation 7 Sep 2021 · 2 repositories · arXiv:2109.03201Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models 7 Sep 2021 · 0 repositories · arXiv:2109.03137
-
PAUSE: Positive and Annealed Unlabeled Sentence Embedding 7 Sep 2021 · 1 repository · arXiv:2109.03155Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Puzzle Solving without Search or Human Knowledge: An Unnatural Language Approach 7 Sep 2021 · 0 repositories · arXiv:2109.02797
-
Refining BERT Embeddings for Document Hashing via Mutual Information Maximization 7 Sep 2021 · 1 repository · arXiv:2109.02867
-
Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos 7 Sep 2021 · 8 repositories · arXiv:2109.03223
-
Text-Free Prosody-Aware Generative Spoken Language Modeling 7 Sep 2021 · 1 repository · arXiv:2109.03264
-
3D Human Texture Estimation from a Single Image with Transformers 6 Sep 2021 · 1 repository · arXiv:2109.02563Syntology official (archive's flag): 14 ran · 14 ran (of which 7 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica 6 Sep 2021 · 1 repository · arXiv:2109.02738Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction 6 Sep 2021 · 1 repository · arXiv:2109.02403
-
Enhancing Natural Language Representation with Large-Scale Out-of-Domain Commonsense 6 Sep 2021 · 1 repository · arXiv:2109.02572
-
General-Purpose Question-Answering with Macaw 6 Sep 2021 · 2 repositories · arXiv:2109.02593
-
GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain 6 Sep 2021 · 1 repository · arXiv:2109.02555
-
PermuteFormer: Efficient Relative Position Encoding for Long Sequences 6 Sep 2021 · 1 repository · arXiv:2109.02377Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
SS-BERT: Mitigating Identity Terms Bias in Toxic Comment Classification by Utilising the Notion of "Subjectivity" and "Identity Terms" 6 Sep 2021 · 0 repositories · arXiv:2109.02691
-
The Animation Transformer: Visual Correspondence via Segment Matching 6 Sep 2021 · 0 repositories · arXiv:2109.02614
-
Vision Transformers For Weeds and Crops Classification Of High Resolution UAV Images 6 Sep 2021 · 0 repositories · arXiv:2109.02716
-
Voxel Transformer for 3D Object Detection 6 Sep 2021 · 1 repository · arXiv:2109.02497Syntology 0 ran · 7 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Transformer Models for Text Coherence Assessment 5 Sep 2021 · 2 repositories · arXiv:2109.02176
-
Error Detection in Large-Scale Natural Language Understanding Systems Using Transformer Models 4 Sep 2021 · 0 repositories · arXiv:2109.01754
-
Uncovering the Limits of Text-based Emotion Detection 4 Sep 2021 · 2 repositories · arXiv:2109.01900
-
A Context-Aware Hierarchical BERT Fusion Network for Multi-turn Dialog Act Detection 3 Sep 2021 · 1 repository · arXiv:2109.01267
-
Contextualized Embeddings based Convolutional Neural Networks for Duplicate Question Identification 3 Sep 2021 · 0 repositories · arXiv:2109.01560
-
Finetuned Language Models Are Zero-Shot Learners 3 Sep 2021 · 8 repositories · arXiv:2109.01652Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)
-
IMG2SMI: Translating Molecular Structure Images to Simplified Molecular-input Line-entry System 3 Sep 2021 · 0 repositories · arXiv:2109.04202
-
Semantic Segmentation on VSPW Dataset through Aggregation of Transformer Models 3 Sep 2021 · 0 repositories · arXiv:2109.01316
-
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation 2 Sep 2021 · 5 repositories · arXiv:2109.00859Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)