Methods › General › Attention Mechanisms › Attention › Papers, page 308

Attention Is All You Need

Attention

Papers archive 2025-07-28

archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)

Page 308 of 316: papers 30,701 to 30,800 of 31,583, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Predicting retrosynthetic pathways using a combined linguistic model and hyper-graph exploration strategy
  17 Oct 2019 · 0 repositories · arXiv:1910.08036
• Question Classification with Deep Contextualized Transformer
  17 Oct 2019 · 1 repository · arXiv:1910.10492
• Universal Text Representation from BERT: An Empirical Study
  17 Oct 2019 · 0 repositories · arXiv:1910.07973
• BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Model Performance
  16 Oct 2019 · 1 repository · arXiv:1910.07181
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Bridging the Knowledge Gap: Enhancing Question Answering with World and Domain Knowledge
  16 Oct 2019 · 0 repositories · arXiv:1910.07429
• Efficiency through Auto-Sizing: Notre Dame NLP's Submission to the WNGT 2019 Efficiency Task
  16 Oct 2019 · 0 repositories · arXiv:1910.07134
• Evolution of transfer learning in natural language processing
  16 Oct 2019 · 0 repositories · arXiv:1910.07370
• Imperial College London Submission to VATEX Video Captioning Task
  16 Oct 2019 · 0 repositories · arXiv:1910.07482
• Injecting Hierarchy with U-Net Transformers
  16 Oct 2019 · 2 repositories · arXiv:1910.10488
• Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models
  16 Oct 2019 · 0 repositories · arXiv:1910.07117
• Transformer ASR with Contextual Block Processing
  16 Oct 2019 · 0 repositories · arXiv:1910.07204
• Using Whole Document Context in Neural Machine Translation
  16 Oct 2019 · 0 repositories · arXiv:1910.07481
• Aligning Cross-Lingual Entities with Multi-Aspect Information
  15 Oct 2019 · 1 repository · arXiv:1910.06575
• Answering Complex Open-domain Questions Through Iterative Query Generation
  15 Oct 2019 · 1 repository · arXiv:1910.07000
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
  15 Oct 2019 · 3 repositories · arXiv:1910.06611
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
• Facebook AI's WAT19 Myanmar-English Translation Task Submission
  15 Oct 2019 · 0 repositories · arXiv:1910.06848
• Structured Pruning of a BERT-based Question Answering Model
  14 Oct 2019 · 0 repositories · arXiv:1910.06360
• Q8BERT: Quantized 8Bit BERT
  14 Oct 2019 · 5 repositories · arXiv:1910.06188
  Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• STANCY: Stance Classification Based on Consistency Cues
  14 Oct 2019 · 1 repository · arXiv:1910.06048
• Transformers without Tears: Improving the Normalization of Self-Attention
  14 Oct 2019 · 5 repositories · arXiv:1910.05895
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Whatcha lookin' at? DeepLIFTing BERT's Attention in Question Answering
  14 Oct 2019 · 1 repository · arXiv:1910.06431
• Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT
  13 Oct 2019 · 0 repositories · arXiv:1910.05786
• Stabilizing Transformers for Reinforcement Learning
  13 Oct 2019 · 5 repositories · arXiv:1910.06764
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
  12 Oct 2019 · 3 repositories · arXiv:1910.05453
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Automatic segmentation of texts into units of meaning for reading assistance
  11 Oct 2019 · 0 repositories · arXiv:1910.05014
• BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novels
  11 Oct 2019 · 1 repository · arXiv:1910.05040
• exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models
  11 Oct 2019 · 1 repository · arXiv:1910.05276
• Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework
  10 Oct 2019 · 2 repositories · arXiv:1910.04708
• FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams
  10 Oct 2019 · 3 repositories · arXiv:1910.04345
• Multi-label Categorization of Accounts of Sexism using a Neural Framework
  10 Oct 2019 · 1 repository · arXiv:1910.04602
• Multilingual Question Answering from Formatted Text applied to Conversational Agents
  10 Oct 2019 · 0 repositories · arXiv:1910.04659
• On Recognizing Texts of Arbitrary Shapes with 2D Self-Attention
  10 Oct 2019 · 2 repositories · arXiv:1910.04396
• Orthogonality Constrained Multi-Head Attention For Keyword Spotting
  10 Oct 2019 · 0 repositories · arXiv:1910.04500
• Structured Pruning of Large Language Models
  10 Oct 2019 · 2 repositories · arXiv:1910.04732
  Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 2 pointer-only (licence)
• Visual Natural Language Query Auto-Completion for Estimating Instance Probabilities
  10 Oct 2019 · 1 repository · arXiv:1910.04887
• A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
  9 Oct 2019 · 0 repositories · arXiv:1910.04176
• Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models
  9 Oct 2019 · 1 repository · arXiv:1910.03756
• Is Multilingual BERT Fluent in Language Generation?
  9 Oct 2019 · 1 repository · arXiv:1910.03806
• On the adequacy of untuned warmup for adaptive optimization
  9 Oct 2019 · 1 repository · arXiv:1910.04209
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
• PipeMare: Asynchronous Pipeline Parallel DNN Training
  9 Oct 2019 · 0 repositories · arXiv:1910.05124
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
  9 Oct 2019 · 9 repositories · arXiv:1910.03771
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Knowledge Distillation from Internal Representations
  8 Oct 2019 · 0 repositories · arXiv:1910.03723
• Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting
  8 Oct 2019 · 0 repositories · arXiv:1910.03650
• SesameBERT: Attention for Anywhere
  8 Oct 2019 · 0 repositories · arXiv:1910.03176
• BERT for Evidence Retrieval and Claim Verification
  7 Oct 2019 · 2 repositories · arXiv:1910.02655
  Syntology 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Parallel Iterative Edit Models for Local Sequence Transduction
  7 Oct 2019 · 1 repository · arXiv:1910.02893
• SMArT: Training Shallow Memory-aware Transformers for Robotic Explainability
  7 Oct 2019 · 0 repositories · arXiv:1910.02974
• Named Entity Recognition -- Is there a glass ceiling?
  6 Oct 2019 · 1 repository · arXiv:1910.02403
• Attention-based Fault-tolerant Approach for Multi-agent Reinforcement Learning Systems
  5 Oct 2019 · 0 repositories · arXiv:1910.02240
• How Transformer Revitalizes Character-based Neural Machine Translation: An Investigation on Japanese-Vietnamese Translation Systems
  5 Oct 2019 · 1 repository · arXiv:1910.02238
• Distilling BERT into Simple Neural Networks with Unlabeled Transfer Data
  4 Oct 2019 · 0 repositories · arXiv:1910.01769
• Fine-grained Sentiment Classification using BERT
  4 Oct 2019 · 1 repository · arXiv:1910.03474
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
  4 Oct 2019 · 10 repositories · arXiv:1910.02054
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Neural Zero-Inflated Quality Estimation Model For Automatic Speech Recognition System
  3 Oct 2019 · 0 repositories · arXiv:1910.01289
• Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation
  3 Oct 2019 · 1 repository · arXiv:1910.01462
• Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations
  2 Oct 2019 · 0 repositories · arXiv:1910.01157
• DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
  2 Oct 2019 · 37 repositories · arXiv:1910.01108
  Syntology official (archive's flag): 1 ran · 21 ran (of which 5 constructed an object rather than computing a result; 13 with no instrument failure: 3 honoured, 1 violated, 9 with no contract checked; 8 where Syntology's instrument failed) · 6 unverified (of 27 harvested samples) · 2 pointer-only (licence)
• Exploiting BERT for End-to-End Aspect-based Sentiment Analysis
  2 Oct 2019 · 1 repository · arXiv:1910.00883
• Linking artificial and human neural representations of language
  2 Oct 2019 · 1 repository · arXiv:1910.01244
  Syntology 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 3 pointer-only (licence)
• Application of Low-resource Machine Translation Techniques to Russian-Tatar Language Pair
  1 Oct 2019 · 0 repositories · arXiv:1910.00368
• Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation
  1 Oct 2019 · 1 repository · arXiv:1910.06717
• BERT for Question Generation
  1 Oct 2019 · 0 repositories
• Dialogue Transformers
  1 Oct 2019 · 1 repository · arXiv:1910.00486
• Efficiency Metrics for Data-Driven Models: A Text Summarization Case Study
  1 Oct 2019 · 0 repositories
• Entangled Transformer for Image Captioning
  1 Oct 2019 · 0 repositories
• Grammatical Error Correction in Low-Resource Scenarios
  1 Oct 2019 · 1 repository · arXiv:1910.00353
• Better Document-Level Machine Translation with Bayes' Rule
  1 Oct 2019 · 0 repositories · arXiv:1910.00553
• Specializing Word Embeddings (for Parsing) by Information Bottleneck
  1 Oct 2019 · 1 repository · arXiv:1910.00163
• TMLab: Generative Enhanced Model (GEM) for adversarial attacks
  1 Oct 2019 · 0 repositories · arXiv:1910.00337
• VAE-PGN based Abstractive Model in Multi-stage Architecture for Text Summarization
  1 Oct 2019 · 0 repositories
• End-to-End Resume Parsing and Finding Candidates for a Job Description using BERT
  30 Sep 2019 · 0 repositories · arXiv:1910.03089
• Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations
  30 Sep 2019 · 0 repositories · arXiv:1910.00058
• Fake news detection using Deep Learning
  29 Sep 2019 · 2 repositories · arXiv:1910.03496
• GDP: Generalized Device Placement for Dataflow Graphs
  28 Sep 2019 · 0 repositories · arXiv:1910.01578
• HateMonitors: Language Agnostic Abuse Detection in Social Media
  27 Sep 2019 · 1 repository · arXiv:1909.12642
• On the use of BERT for Neural Machine Translation
  27 Sep 2019 · 0 repositories · arXiv:1909.12744
• Reweighted Proximal Pruning for Large-Scale Language Representation
  27 Sep 2019 · 0 repositories · arXiv:1909.12486
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  26 Sep 2019 · 48 repositories · arXiv:1909.11942
  Syntology official (archive's flag): 6 ran · 81 ran (of which 17 constructed an object rather than computing a result; 59 with no instrument failure: 4 honoured, 0 violated, 55 with no contract checked; 22 where Syntology's instrument failed) · 45 unverified (of 126 harvested samples) · 28 pointer-only (licence)
• Aspect and Opinion Term Extraction for Hotel Reviews using Transfer Learning and Auxiliary Labels
  26 Sep 2019 · 0 repositories · arXiv:1909.11879
• Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture
  26 Sep 2019 · 0 repositories · arXiv:1909.12411
• Improving Pre-Trained Multilingual Models with Vocabulary Expansion
  26 Sep 2019 · 0 repositories · arXiv:1909.12440
• Monotonic Multihead Attention
  26 Sep 2019 · 3 repositories · arXiv:1909.12406
• Universal Graph Transformer Self-Attention Networks
  26 Sep 2019 · 1 repository · arXiv:1909.11855
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
• Attention Convolutional Binary Neural Tree for Fine-Grained Visual Categorization
  25 Sep 2019 · 2 repositories · arXiv:1909.11378
• Extremely Small BERT Models from Mixed-Vocabulary Training
  25 Sep 2019 · 0 repositories · arXiv:1909.11687
• Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis
  25 Sep 2019 · 0 repositories · arXiv:1909.11297
• Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models
  25 Sep 2019 · 2 repositories · arXiv:1909.11299
• Reducing Transformer Depth on Demand with Structured Dropout
  25 Sep 2019 · 5 repositories · arXiv:1909.11556
• Knowledge-Enriched Transformer for Emotion Detection in Textual Conversations
  24 Sep 2019 · 1 repository · arXiv:1909.10681
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Technical report on Conversational Question Answering
  24 Sep 2019 · 0 repositories · arXiv:1909.10772
• Efficiently Reusing Old Models Across Languages via Transfer Learning
  24 Sep 2019 · 0 repositories · arXiv:1909.10955
• Understanding Semantics from Speech Through Pre-training
  24 Sep 2019 · 0 repositories · arXiv:1909.10924
• Unified Vision-Language Pre-Training for Image Captioning and VQA
  24 Sep 2019 · 3 repositories · arXiv:1909.11059
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
• TinyBERT: Distilling BERT for Natural Language Understanding
  23 Sep 2019 · 10 repositories · arXiv:1909.10351
  Syntology official: harvested, nothing ran · 0 ran · 4 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings
  23 Sep 2019 · 1 repository · arXiv:1909.10430
• Automatic Identification and Normalisation of Physical Measurements in Scientific Literature
  23 Sep 2019 · 1 repository
• Portuguese Named Entity Recognition using BERT-CRF
  23 Sep 2019 · 1 repository · arXiv:1909.10649
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Self-attention based end-to-end Hindi-English Neural Machine Translation
  21 Sep 2019 · 0 repositories · arXiv:1909.09779
• Adversarial Learning of General Transformations for Data Augmentation
  21 Sep 2019 · 0 repositories · arXiv:1909.09801
• BERT Meets Chinese Word Segmentation
  20 Sep 2019 · 0 repositories · arXiv:1909.09292