Methods › General › Attention Mechanisms › Attention › Papers, page 297

Attention Is All You Need

Attention

Papers archive 2025-07-28

archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)

Page 297 of 316: papers 29,601 to 29,700 of 31,583, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Visual Transformers: Token-based Image Representation and Processing for Computer Vision
  5 Jun 2020 · 8 repositories · arXiv:2006.03677
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
• End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020
  4 Jun 2020 · 0 repositories · arXiv:2006.02965
• The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain
  4 Jun 2020 · 1 repository · arXiv:2006.03039
• Automatic Text Summarization of COVID-19 Medical Research Articles using BERT and GPT-2
  3 Jun 2020 · 1 repository · arXiv:2006.01997
• A Pairwise Probe for Understanding BERT Fine-Tuning on Machine Reading Comprehension
  2 Jun 2020 · 0 repositories · arXiv:2006.01346
• BERT Based Multilingual Machine Comprehension in English and Hindi
  2 Jun 2020 · 2 repositories · arXiv:2006.01432
• Exploring Cross-sentence Contexts for Named Entity Recognition with BERT
  2 Jun 2020 · 1 repository · arXiv:2006.01563
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior
  2 Jun 2020 · 1 repository · arXiv:2006.01912
• Position Masking for Language Models
  2 Jun 2020 · 0 repositories · arXiv:2006.05676
• Question Answering on Scholarly Knowledge Graphs
  2 Jun 2020 · 0 repositories · arXiv:2006.01527
• Subjective Question Answering: Deciphering the inner workings of Transformers in the realm of subjectivity
  2 Jun 2020 · 1 repository · arXiv:2006.08342
• WikiBERT models: deep transfer learning for many languages
  2 Jun 2020 · 0 repositories · arXiv:2006.01538
• ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  1 Jun 2020 · 4 repositories · arXiv:2006.00719
  Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples) · 1 pointer-only (licence)
• An Effective Contextual Language Modeling Framework for Speech Summarization with Augmented Features
  1 Jun 2020 · 0 repositories · arXiv:2006.01189
• Approche de génération de réponse à base de transformers (Transformer based approach for answer generation)
  1 Jun 2020 · 0 repositories
• BERT-based Ensembles for Modeling Disclosure and Support in Conversational Social Media Text
  1 Jun 2020 · 0 repositories · arXiv:2006.01222
• Context-based Transformer Models for Answer Sentence Selection
  1 Jun 2020 · 1 repository · arXiv:2006.01285
• Conversational Machine Comprehension: a Literature Review
  1 Jun 2020 · 0 repositories · arXiv:2006.00671
• Emergence of Separable Manifolds in Deep Language Representations
  1 Jun 2020 · 1 repository · arXiv:2006.01095
• Étude des variations sémantiques à travers plusieurs dimensions (Studying semantic variations through several dimensions )
  1 Jun 2020 · 0 repositories
• Few-Shot Learning of Part-Specific Probability Space for 3D Shape Segmentation
  1 Jun 2020 · 0 repositories
• Image Search With Text Feedback by Visiolinguistic Attention Learning
  1 Jun 2020 · 1 repository
• Introduction d'informations sémantiques dans un système de reconnaissance de la parole (Despite spectacular advances in recent years, the Automatic Speech Recognition (ASR) systems still make mistakes, especially in noisy environments)
  1 Jun 2020 · 0 repositories
• Les modèles de langue contextuels Camembert pour le français : impact de la taille et de l'hétérogénéité des données d'entrainement (C AMEM BERT Contextual Language Models for French: Impact of Training Data Size and Heterogeneity )
  1 Jun 2020 · 0 repositories
• Hyperparameter optimization with REINFORCE and Transformers
  1 Jun 2020 · 0 repositories · arXiv:2006.00939
• Online Versus Offline NMT Quality: An In-depth Analysis on English-German and German-English
  1 Jun 2020 · 1 repository · arXiv:2006.00814
• Qu'apporte BERT à l'analyse syntaxique en constituants discontinus ? Une suite de tests pour évaluer les prédictions de structures syntaxiques discontinues en anglais (What does BERT contribute to discontinuous constituency parsing ? A test suite to evaluate discontinuous constituency structure predictions in English)
  1 Jun 2020 · 0 repositories
• Ré-entraîner ou entraîner soi-même ? Stratégies de pré-entraînement de BERT en domaine médical (Re-train or train from scratch ? Pre-training strategies for BERT in the medical domain )
  1 Jun 2020 · 0 repositories
• RDCFace: Radial Distortion Correction for Face Recognition
  1 Jun 2020 · 0 repositories
• Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism
  1 Jun 2020 · 0 repositories · arXiv:2006.00697
• Unsupervised Sparse-view Backprojection via Convolutional and Spatial Transformer Networks
  1 Jun 2020 · 0 repositories · arXiv:2006.01658
• Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
  1 Jun 2020 · 0 repositories · arXiv:2006.00995
• BPGC at SemEval-2020 Task 11: Propaganda Detection in News Articles with Multi-Granularity Knowledge Sharing and Linguistic Features based Ensemble Learning
  31 May 2020 · 0 repositories · arXiv:2006.00593
• CNRL at SemEval-2020 Task 5: Modelling Causal Reasoning in Language with Multi-Head Self-Attention Weights based Counterfactual Detection
  31 May 2020 · 0 repositories · arXiv:2006.00609
• "Judge me by my size (noun), do you?'' YodaLib: A Demographic-Aware Humor Generation Framework
  31 May 2020 · 0 repositories · arXiv:2006.00578
• LRG at SemEval-2020 Task 7: Assessing the Ability of BERT and Derivative Models to Perform Short-Edits based Humor Grading
  31 May 2020 · 0 repositories · arXiv:2006.00607
• Neural Entity Linking: A Survey of Models Based on Deep Learning
  31 May 2020 · 0 repositories · arXiv:2006.00575
• Detecting Problem Statements in Peer Assessments
  30 May 2020 · 0 repositories · arXiv:2006.04532
• A Comparative Study of Lexical Substitution Approaches based on Neural Language Models
  29 May 2020 · 0 repositories · arXiv:2006.00031
• First Neural Conjecturing Datasets and Experiments
  29 May 2020 · 0 repositories · arXiv:2005.14664
• SAFER: A Structure-free Approach for Certified Robustness to Adversarial Word Substitutions
  29 May 2020 · 1 repository · arXiv:2005.14424
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Stance Prediction for Contemporary Issues: Data and Experiments
  29 May 2020 · 1 repository · arXiv:2006.00052
• Using Large Pretrained Language Models for Answering User Queries from Product Specifications
  29 May 2020 · 0 repositories · arXiv:2005.14613
• Empirical Evaluation of Pretraining Strategies for Supervised Entity Linking
  28 May 2020 · 0 repositories · arXiv:2005.14253
• HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  28 May 2020 · 4 repositories · arXiv:2005.14187
• Language Models are Few-Shot Learners
  28 May 2020 · 67 repositories · arXiv:2005.14165
  Syntology community repositories only · 45 ran (of which 0 constructed an object rather than computing a result; 40 with no instrument failure: 2 honoured, 1 violated, 37 with no contract checked; 5 where Syntology's instrument failed) · 20 unverified (of 65 harvested samples) · 7 pointer-only (licence)
• On Incorporating Structural Information to improve Dialogue Response Generation
  28 May 2020 · 1 repository · arXiv:2005.14315
• Variational Neural Machine Translation with Normalizing Flows
  28 May 2020 · 0 repositories · arXiv:2005.13978
• CausaLM: Causal Model Explanation Through Counterfactual Language Models
  27 May 2020 · 1 repository · arXiv:2005.13407
  Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• A Quantitative Survey of Communication Optimizations in Distributed Deep Learning
  27 May 2020 · 1 repository · arXiv:2005.13247
• General-Purpose User Embeddings based on Mobile App Usage
  27 May 2020 · 1 repository · arXiv:2005.13303
• Language Representation Models for Fine-Grained Sentiment Classification
  27 May 2020 · 1 repository · arXiv:2005.13619
• Network-to-Network Translation with Conditional Invertible Neural Networks
  27 May 2020 · 1 repository · arXiv:2005.13580
• Permutation Matters: Anisotropic Convolutional Layer for Learning on Point Clouds
  27 May 2020 · 1 repository · arXiv:2005.13135
• Syntactic Structure Distillation Pretraining For Bidirectional Encoders
  27 May 2020 · 0 repositories · arXiv:2005.13482
• Transition-based Semantic Dependency Parsing with Pointer Networks
  27 May 2020 · 1 repository · arXiv:2005.13344
• A Data-driven Approach for Noise Reduction in Distantly Supervised Biomedical Relation Extraction
  26 May 2020 · 1 repository · arXiv:2005.12565
• BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection
  26 May 2020 · 1 repository · arXiv:2005.12503
• BERT-XML: Large Scale Automated ICD Coding Using BERT Pretraining
  26 May 2020 · 0 repositories · arXiv:2006.03685
• Comparing BERT against traditional machine learning text classification
  26 May 2020 · 0 repositories · arXiv:2005.13012
• End-to-End Object Detection with Transformers
  26 May 2020 · 37 repositories · arXiv:2005.12872
  Syntology official (archive's flag): 2 ran · 70 ran (of which 45 constructed an object rather than computing a result; 62 with no instrument failure: 2 honoured, 1 violated, 59 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified (of 92 harvested samples) · 19 pointer-only (licence)
• GECToR -- Grammatical Error Correction: Tag, Not Rewrite
  26 May 2020 · 3 repositories · arXiv:2005.12592
  Syntology official (archive's flag): 8 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 1 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
• Guiding Symbolic Natural Language Grammar Induction via Transformer-Based Sequence Probabilities
  26 May 2020 · 0 repositories · arXiv:2005.12533
• ParsBERT: Transformer-based Model for Persian Language Understanding
  26 May 2020 · 3 repositories · arXiv:2005.12515
• Pay Attention to What You Read: Non-recurrent Handwritten Text-Line Recognition
  26 May 2020 · 0 repositories · arXiv:2005.13044
• What Are People Asking About COVID-19? A Question Classification Dataset
  26 May 2020 · 2 repositories · arXiv:2005.12522
• An Audio-enriched BERT-based Framework for Spoken Multiple-choice Question Answering
  25 May 2020 · 0 repositories · arXiv:2005.12142
• Deep Learning Models for Automatic Summarization
  25 May 2020 · 0 repositories · arXiv:2005.11988
• Køpsala: Transition-Based Graph Parsing via Efficient Training and Effective Encoding
  25 May 2020 · 1 repository · arXiv:2005.12094
• Pointwise Paraphrase Appraisal is Potentially Problematic
  25 May 2020 · 0 repositories · arXiv:2005.11996
• The Unreasonable Volatility of Neural Machine Translation Models
  25 May 2020 · 1 repository · arXiv:2005.12398
• Adversarial NLI for Factual Correctness in Text Summarisation Models
  24 May 2020 · 0 repositories · arXiv:2005.11739
• Jointly Encoding Word Confusion Network and Dialogue Context with BERT for Spoken Language Understanding
  24 May 2020 · 1 repository · arXiv:2005.11640
• Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Model
  24 May 2020 · 2 repositories · arXiv:2005.11849
• Devising Malware Characterstics using Transformers
  23 May 2020 · 0 repositories · arXiv:2005.12978
• A Generative Approach to Titling and Clustering Wikipedia Sections
  22 May 2020 · 0 repositories · arXiv:2005.11216
• Character-level Transformer-based Neural Machine Translation
  22 May 2020 · 0 repositories · arXiv:2005.11239
• Comparative Study of Machine Learning Models and BERT on SQuAD
  22 May 2020 · 1 repository · arXiv:2005.11313
• L2R2: Leveraging Ranking for Abductive Reasoning
  22 May 2020 · 1 repository · arXiv:2005.11223
• Living Machines: A study of atypical animacy
  22 May 2020 · 1 repository · arXiv:2005.11140
• Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selection
  22 May 2020 · 1 repository · arXiv:2005.11185
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction
  22 May 2020 · 1 repository · arXiv:2005.12833
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  22 May 2020 · 18 repositories · arXiv:2005.11401
  Syntology 6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
• Robust Layout-aware IE for Visually Rich Documents with Pre-trained Language Models
  22 May 2020 · 0 repositories · arXiv:2005.11017
• Transformer-based Context-aware Sarcasm Detection in Conversation Threads from Social Media
  22 May 2020 · 0 repositories · arXiv:2005.11424
• Leveraging Text Data Using Hybrid Transformer-LSTM Based End-to-End ASR in Transfer Learning
  21 May 2020 · 0 repositories · arXiv:2005.10407
• Simplified Self-Attention for Transformer-based End-to-End Speech Recognition
  21 May 2020 · 0 repositories · arXiv:2005.10463
• Text-to-Text Pre-Training for Data-to-Text Tasks
  21 May 2020 · 2 repositories · arXiv:2005.10433
• A Further Study of Unsupervised Pre-training for Transformer Based Speech Recognition
  20 May 2020 · 1 repository · arXiv:2005.09862
• Applying the Transformer to Character-level Transduction
  20 May 2020 · 3 repositories · arXiv:2005.10213
  Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)
• BERTweet: A pre-trained language model for English Tweets
  20 May 2020 · 3 repositories · arXiv:2005.10200
• Artificial Intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry
  20 May 2020 · 1 repository · arXiv:2005.09980
• FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval
  20 May 2020 · 3 repositories · arXiv:2005.09801
• Relative Positional Encoding for Speech Recognition and Direct Translation
  20 May 2020 · 0 repositories · arXiv:2005.09940
• Human Sentence Processing: Recurrence or Attention?
  19 May 2020 · 1 repository · arXiv:2005.09471
• Cross-lingual Approaches for Task-specific Dialogue Act Recognition
  19 May 2020 · 0 repositories · arXiv:2005.09260
• Exploring Transformers for Large-Scale Speech Recognition
  19 May 2020 · 0 repositories · arXiv:2005.09684
• Should we hard-code the recurrence concept or learn it instead ? Exploring the Transformer architecture for Audio-Visual Speech Recognition
  19 May 2020 · 1 repository · arXiv:2005.09297
• Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestalt
  19 May 2020 · 1 repository · arXiv:2005.09159
• Table Search Using a Deep Contextualized Language Model
  19 May 2020 · 1 repository · arXiv:2005.09207