Methods › General › Attention Mechanisms › Attention › Papers, page 315

Attention Is All You Need

Attention

Papers archive 2025-07-28

archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)

Page 315 of 316: papers 31,401 to 31,500 of 31,583, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Language Models are Unsupervised Multitask Learners
  14 Feb 2019 · 21 repositories
• Machine Reading Comprehension for Answer Re-Ranking in Customer Support Chatbots
  12 Feb 2019 · 0 repositories · arXiv:1902.04574
• BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model
  11 Feb 2019 · 13 repositories · arXiv:1902.04094
  Syntology official (archive's flag): 2 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 2 pointer-only (licence)
• Improving Deep Image Clustering With Spatial Transformer Layers
  9 Feb 2019 · 0 repositories · arXiv:1902.05401
• Insertion Transformer: Flexible Sequence Generation via Insertion Operations
  8 Feb 2019 · 0 repositories · arXiv:1902.03249
• BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning
  7 Feb 2019 · 2 repositories · arXiv:1902.02671
• AlphaStar: An Evolutionary Computation Perspective
  5 Feb 2019 · 0 repositories · arXiv:1902.01724
• End-to-End Open-Domain Question Answering with BERTserini
  5 Feb 2019 · 1 repository · arXiv:1902.01718
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 3 pointer-only (licence)
• A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
  4 Feb 2019 · 5 repositories · arXiv:1902.01069
  Syntology official (archive's flag): 3 ran · 21 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 2 violated, 1 with no contract checked; 16 where Syntology's instrument failed) · 15 unverified (of 36 harvested samples) · 33 pointer-only (licence)
• Insertion-based Decoding with automatically Inferred Generation Order
  4 Feb 2019 · 0 repositories · arXiv:1902.01370
• Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
  4 Feb 2019 · 6 repositories · arXiv:1902.01007
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Parameter-Efficient Transfer Learning for NLP
  2 Feb 2019 · 17 repositories · arXiv:1902.00751
  Syntology official: harvested, nothing ran · 14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 22 harvested samples) · 3 pointer-only (licence)
• Adding Interpretable Attention to Neural Translation Models Improves Word Alignment
  31 Jan 2019 · 1 repository · arXiv:1901.11359
• Multi-Task Deep Neural Networks for Natural Language Understanding
  31 Jan 2019 · 7 repositories · arXiv:1901.11504
  Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 4 pointer-only (licence)
• The Second Conversational Intelligence Challenge (ConvAI2)
  31 Jan 2019 · 2 repositories · arXiv:1902.00098
• The Evolved Transformer
  30 Jan 2019 · 3 repositories · arXiv:1901.11117
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
  25 Jan 2019 · 19 repositories · arXiv:1901.08746
  Syntology official: no sample here; runs from other or unrecorded repositories · 15 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (of 25 harvested samples) · 3 pointer-only (licence)
• A BERT Baseline for the Natural Questions
  24 Jan 2019 · 3 repositories · arXiv:1901.08634
  Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
• Sequential Skip Prediction with Few-shot in Streamed Music Contents
  24 Jan 2019 · 1 repository · arXiv:1901.08203
• Self-Attentive Model for Headline Generation
  23 Jan 2019 · 0 repositories · arXiv:1901.07786
• TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
  23 Jan 2019 · 23 repositories · arXiv:1901.08149
  Syntology 18 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 7 where Syntology's instrument failed) · 8 unverified (of 26 harvested samples) · 7 pointer-only (licence)
• Cross-lingual Language Model Pretraining
  22 Jan 2019 · 17 repositories · arXiv:1901.07291
  Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Linearized Multi-Sampling for Differentiable Image Transformation
  22 Jan 2019 · 1 repository · arXiv:1901.07124
• Assessing BERT's Syntactic Abilities
  16 Jan 2019 · 3 repositories · arXiv:1901.05287
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Passage Re-ranking with BERT
  13 Jan 2019 · 6 repositories · arXiv:1901.04085
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)
• Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments
  11 Jan 2019 · 0 repositories · arXiv:1901.03438
• Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques
  10 Jan 2019 · 1 repository · arXiv:1901.03116
• On the Turing Completeness of Modern Neural Network Architectures
  10 Jan 2019 · 0 repositories · arXiv:1901.03429
• Composite Shape Modeling via Latent Space Factorization
  9 Jan 2019 · 0 repositories · arXiv:1901.02968
• Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
  9 Jan 2019 · 37 repositories · arXiv:1901.02860
  Syntology official (archive's flag): 8 ran · 67 ran (of which 37 constructed an object rather than computing a result; 49 with no instrument failure: 4 honoured, 1 violated, 44 with no contract checked; 18 where Syntology's instrument failed) · 76 unverified (of 143 harvested samples) · 43 pointer-only (licence)
• Team Papelo: Transformer Networks at FEVER
  8 Jan 2019 · 1 repository · arXiv:1901.02534
• DPPNet: Approximating Determinantal Point Processes with Deep Networks
  7 Jan 2019 · 0 repositories · arXiv:1901.02051
• Multilingual Constituency Parsing with Self-Attention and Pre-Training
  31 Dec 2018 · 4 repositories · arXiv:1812.11760
  Syntology official (archive's flag): 8 ran · 22 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 0 honoured, 0 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 28 harvested samples) · 3 pointer-only (licence)
• Skeleton Transformer Networks: 3D Human Pose and Skinned Mesh from Single RGB Image
  29 Dec 2018 · 0 repositories · arXiv:1812.11328
• Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
  28 Dec 2018 · 0 repositories · arXiv:1812.10860
• DTMT: A Novel Deep Transition Architecture for Neural Machine Translation
  19 Dec 2018 · 1 repository · arXiv:1812.07807
• Multitask Painting Categorization by Deep Multibranch Neural Network
  19 Dec 2018 · 0 repositories · arXiv:1812.08052
• Self-Attention: A Better Building Block for Sentiment Analysis Neural Network Classifiers
  19 Dec 2018 · 1 repository · arXiv:1812.07860
• Conditional BERT Contextual Augmentation
  17 Dec 2018 · 5 repositories · arXiv:1812.06705
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Nrityantar: Pose oblivious Indian classical dance sequence classification system
  13 Dec 2018 · 0 repositories · arXiv:1812.05231
• Hyperbolic Deep Learning for Chinese Natural Language Understanding
  11 Dec 2018 · 0 repositories · arXiv:1812.10408
• Few-Shot Learning via Embedding Adaptation with Set-to-Set Functions
  10 Dec 2018 · 6 repositories · arXiv:1812.03664
• SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering
  10 Dec 2018 · 6 repositories · arXiv:1812.03593
• Kernel Transformer Networks for Compact Spherical Convolution
  7 Dec 2018 · 0 repositories · arXiv:1812.03115
• The USTC-NEL Speech Translation system at IWSLT 2018
  6 Dec 2018 · 0 repositories · arXiv:1812.02455
• Video Action Transformer Network
  6 Dec 2018 · 0 repositories · arXiv:1812.02707
• Attending to Mathematical Language with Transformers
  5 Dec 2018 · 3 repositories · arXiv:1812.02825
• Practical Text Classification With Large Pre-Trained Language Models
  4 Dec 2018 · 1 repository · arXiv:1812.01207
• Layer-Wise Coordination between Encoder and Decoder for Neural Machine Translation
  1 Dec 2018 · 0 repositories
• Learning RoI Transformer for Detecting Oriented Objects in Aerial Images
  1 Dec 2018 · 1 repository · arXiv:1812.00155
  Syntology 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
• Grammars and reinforcement learning for molecule optimization
  27 Nov 2018 · 1 repository · arXiv:1811.11222
• Iterative Transformer Network for 3D Point Cloud
  27 Nov 2018 · 1 repository · arXiv:1811.11209
• GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
  16 Nov 2018 · 13 repositories · arXiv:1811.06965
  Syntology 20 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 0 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 25 harvested samples) · 16 pointer-only (licence)
• Identification of Internal Faults in Indirect Symmetrical Phase Shift Transformers Using Ensemble Learning
  12 Nov 2018 · 0 repositories · arXiv:1811.04537
• Input Combination Strategies for Multi-Source Transformer Decoder
  12 Nov 2018 · 0 repositories · arXiv:1811.04716
• Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Prediction
  6 Nov 2018 · 1 repository · arXiv:1811.02633
• Mesh-TensorFlow: Deep Learning for Supercomputers
  5 Nov 2018 · 1 repository · arXiv:1811.02084
• Simple, Distributed, and Accelerated Probabilistic Programming
  5 Nov 2018 · 1 repository · arXiv:1811.02091
• Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks
  2 Nov 2018 · 1 repository · arXiv:1811.01088
• An Analysis of Encoder Representations in Transformer-Based Machine Translation
  1 Nov 2018 · 0 repositories
• Extracting Syntactic Trees from Transformer Encoder Self-Attentions
  1 Nov 2018 · 0 repositories
• Hybrid Self-Attention Network for Machine Translation
  1 Nov 2018 · 0 repositories · arXiv:1811.00253
• Convolutional Self-Attention Network
  31 Oct 2018 · 0 repositories · arXiv:1810.13320
• Weakly Supervised Grammatical Error Correction using Iterative Decoding
  31 Oct 2018 · 0 repositories · arXiv:1811.01710
• Parallel Attention Mechanisms in Neural Machine Translation
  29 Oct 2018 · 0 repositories · arXiv:1810.12427
• Recurrent Transformer Networks for Semantic Correspondence
  29 Oct 2018 · 1 repository · arXiv:1810.12155
• Variational Semi-supervised Aspect-term Sentiment Analysis via Transformer
  24 Oct 2018 · 0 repositories · arXiv:1810.10437
• Area Attention
  23 Oct 2018 · 1 repository · arXiv:1810.10126
• An Analysis of Attention Mechanisms: The Case of Word Sense Disambiguation in Neural Machine Translation
  17 Oct 2018 · 0 repositories · arXiv:1810.07595
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  11 Oct 2018 · 534 repositories · arXiv:1810.04805
  Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 235 with no instrument failure: 17 honoured, 4 violated, 214 with no contract checked; 65 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)
• Improving the Transformer Translation Model with Document-Level Context
  8 Oct 2018 · 3 repositories · arXiv:1810.03581
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified (of 12 harvested samples)
• A Transformer-Based Multi-Source Automatic Post-Editing System
  1 Oct 2018 · 0 repositories
• Alibaba Submission for WMT18 Quality Estimation Task
  1 Oct 2018 · 0 repositories
• Alibaba's Neural Machine Translation Systems for WMT18
  1 Oct 2018 · 0 repositories
• CUNI Submissions in WMT18
  1 Oct 2018 · 0 repositories
• CUNI Transformer Neural MT System for WMT18
  1 Oct 2018 · 0 repositories
• Input Combination Strategies for Multi-Source Transformer Decoder
  1 Oct 2018 · 0 repositories
• Multi-encoder Transformer Network for Automatic Post-Editing
  1 Oct 2018 · 0 repositories
• Multi-source transformer with combined losses for automatic post editing
  1 Oct 2018 · 0 repositories
• Neural Machine Translation with the Transformer and Multi-Source Romance Languages for the Biomedical WMT 2018 task
  1 Oct 2018 · 0 repositories
• NTT's Neural Machine Translation Systems for WMT 2018
  1 Oct 2018 · 0 repositories
• Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
  1 Oct 2018 · 9 repositories · arXiv:1810.00825
  Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 3 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 4 pointer-only (licence)
• TencentFmRD Neural Machine Translation for WMT18
  1 Oct 2018 · 0 repositories
• The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018
  1 Oct 2018 · 0 repositories
• The MLLP-UPV German-English Machine Translation System for WMT18
  1 Oct 2018 · 0 repositories
• The NiuTrans Machine Translation System for WMT18
  1 Oct 2018 · 0 repositories
• The RWTH Aachen University Filtering System for the WMT 2018 Parallel Corpus Filtering Task
  1 Oct 2018 · 0 repositories
• The RWTH Aachen University Supervised Machine Translation Systems for WMT 2018
  1 Oct 2018 · 1 repository
• The University of Helsinki submissions to the WMT18 news task
  1 Oct 2018 · 0 repositories
• The University of Maryland's Chinese-English Neural Machine Translation Systems at WMT18
  1 Oct 2018 · 0 repositories
• Tilde's Machine Translation Systems for WMT 2018
  1 Oct 2018 · 1 repository
• Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation
  25 Sep 2018 · 1 repository · arXiv:1809.09296
• Neural Speech Synthesis with Transformer Network
  19 Sep 2018 · 6 repositories · arXiv:1809.08895
• NICT's Neural and Statistical Machine Translation Systems for the WMT18 News Translation Task
  19 Sep 2018 · 0 repositories · arXiv:1809.07037
• Music Transformer
  12 Sep 2018 · 12 repositories · arXiv:1809.04281
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 2 pointer-only (licence)
• On The Alignment Problem In Multi-Head Attention-Based Neural Machine Translation
  11 Sep 2018 · 0 repositories · arXiv:1809.03985
• Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks
  10 Sep 2018 · 1 repository · arXiv:1809.03355
• Neural Allocentric Intuitive Physics Prediction from Real Videos
  7 Sep 2018 · 0 repositories · arXiv:1809.03330
• Towards Automated Customer Support
  2 Sep 2018 · 1 repository · arXiv:1809.00303
• Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter
  1 Sep 2018 · 0 repositories · arXiv:1809.00120