Methods › General › Attention Mechanisms › Attention › Papers, page 281
Attention Is All You Need
Attention
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)
Page 281 of 316: papers 28,001 to 28,100 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Multi-Task Time Series Forecasting With Shared Attention 24 Jan 2021 · 0 repositories · arXiv:2101.09645
-
RomeBERT: Robust Training of Multi-Exit BERT 24 Jan 2021 · 1 repository · arXiv:2101.09755
-
Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models 24 Jan 2021 · 1 repository · arXiv:2101.09688
-
Towards a Better Integration of Fuzzy Matches in Neural Machine Translation through Data Augmentation 24 Jan 2021 · 1 repository
-
Training Multilingual Pre-trained Language Model with Byte-level Subwords 23 Jan 2021 · 1 repository · arXiv:2101.09469
-
A multi-perspective combined recall and rank framework for Chinese procedure terminology normalization 22 Jan 2021 · 0 repositories · arXiv:2101.09101
-
BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets 22 Jan 2021 · 0 repositories · arXiv:2101.09345
-
Drug and Disease Interpretation Learning with Biomedical Entity Representation Transformer 22 Jan 2021 · 1 repository · arXiv:2101.09311
-
Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation 22 Jan 2021 · 0 repositories · arXiv:2101.08942
-
Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision 22 Jan 2021 · 0 repositories · arXiv:2101.09244
-
HASOCOne@FIRE-HASOC2020: Using BERT and Multilingual BERT models for Hate Speech Detection 22 Jan 2021 · 1 repository · arXiv:2101.09007
-
Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification 22 Jan 2021 · 0 repositories · arXiv:2101.09012
-
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT 22 Jan 2021 · 1 repository · arXiv:2101.09115
-
Visual Question Answering based on Local-Scene-Aware Referring Expression Generation 22 Jan 2021 · 0 repositories · arXiv:2101.08978
-
Activity Graph Transformer for Temporal Action Localization 21 Jan 2021 · 0 repositories · arXiv:2101.08540
-
DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition 21 Jan 2021 · 2 repositories · arXiv:2101.08674Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval 21 Jan 2021 · 1 repository · arXiv:2101.08370Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ 21 Jan 2021 · 1 repository · arXiv:2101.08779
-
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates 20 Jan 2021 · 0 repositories · arXiv:2101.08133
-
Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method? 20 Jan 2021 · 1 repository · arXiv:2101.08114
-
Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi 20 Jan 2021 · 1 repository · arXiv:2101.07973
-
Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation 20 Jan 2021 · 0 repositories · arXiv:2101.08106Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 13 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
Open-Domain Conversational Search Assistant with Transformers 20 Jan 2021 · 1 repository · arXiv:2101.08197
-
PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer 20 Jan 2021 · 1 repository · arXiv:2101.07918
-
UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers 20 Jan 2021 · 1 repository · arXiv:2101.08001
-
Fast Convergence of DETR with Spatially Modulated Co-Attention 19 Jan 2021 · 2 repositories · arXiv:2101.07448Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Situation and Behavior Understanding by Trope Detection on Films 19 Jan 2021 · 1 repository · arXiv:2101.07632
-
Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach 19 Jan 2021 · 1 repository · arXiv:2101.07714
-
Automatic punctuation restoration with BERT models 18 Jan 2021 · 1 repository · arXiv:2101.07343
-
Can a Fruit Fly Learn Word Embeddings? 18 Jan 2021 · 2 repositories · arXiv:2101.06887Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Inference for BART with Multinomial Outcomes 18 Jan 2021 · 1 repository · arXiv:2101.06823
-
Dual-Level Collaborative Transformer for Image Captioning 16 Jan 2021 · 1 repository · arXiv:2101.06462
-
Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching 16 Jan 2021 · 1 repository · arXiv:2101.06423
-
Transformer-Based Models for Question Answering on COVID19 16 Jan 2021 · 0 repositories · arXiv:2101.11432
-
Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC 15 Jan 2021 · 0 repositories · arXiv:2101.06326
-
Hostility Detection and Covid-19 Fake News Detection in Social Media 15 Jan 2021 · 0 repositories · arXiv:2101.05953
-
KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization 15 Jan 2021 · 0 repositories · arXiv:2101.05938
-
ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information 14 Jan 2021 · 1 repository · arXiv:2101.05499
-
Exploration of Visual Features and their weighted-additive fusion for Video Captioning 14 Jan 2021 · 0 repositories · arXiv:2101.05806
-
Persistent Anti-Muslim Bias in Large Language Models 14 Jan 2021 · 1 repository · arXiv:2101.05783
-
Training Data Leakage Analysis in Language Models 14 Jan 2021 · 0 repositories · arXiv:2101.05405
-
Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection 14 Jan 2021 · 0 repositories · arXiv:2101.05509
-
WER-BERT: Automatic WER Estimation with BERT in a Balanced Ordinal Classification Paradigm 14 Jan 2021 · 0 repositories · arXiv:2101.05478
-
Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings 13 Jan 2021 · 1 repository · arXiv:2101.04998
-
Experimental Evaluation of Deep Learning models for Marathi Text Classification 13 Jan 2021 · 0 repositories · arXiv:2101.04899
-
Heterogeneous Network Embedding for Deep Semantic Relevance Match in E-commerce Search 13 Jan 2021 · 0 repositories · arXiv:2101.04850
-
LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT 13 Jan 2021 · 1 repository · arXiv:2101.04965
-
Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task 12 Jan 2021 · 0 repositories · arXiv:2101.11425
-
Neural Contract Element Extraction Revisited: Letters from Sesame Street 12 Jan 2021 · 0 repositories · arXiv:2101.04355
-
Neural News Recommendation with Negative Feedback 12 Jan 2021 · 0 repositories · arXiv:2101.04328
-
Of Non-Linearity and Commutativity in BERT 12 Jan 2021 · 1 repository · arXiv:2101.04547
-
A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis 11 Jan 2021 · 0 repositories · arXiv:2101.11423
-
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21 11 Jan 2021 · 0 repositories · arXiv:2101.03700
-
BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer 11 Jan 2021 · 0 repositories · arXiv:2101.04158
-
Evaluation of Deep Learning Models for Hostility Detection in Hindi Text 11 Jan 2021 · 0 repositories · arXiv:2101.04144
-
Investigating the Vision Transformer Model for Image Retrieval Tasks 11 Jan 2021 · 0 repositories · arXiv:2101.03771
-
Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection 11 Jan 2021 · 1 repository · arXiv:2101.03778
-
Spherical Transformer: Adapting Spherical Signal to CNNs 11 Jan 2021 · 0 repositories · arXiv:2101.03848
-
The Slodderwetenschap (Sloppy Science) of Stochastic Parrots -- A Plea for Science to NOT take the Route Advocated by Gebru and Bender 11 Jan 2021 · 0 repositories · arXiv:2101.10098
-
BERT & Family Eat Word Salad: Experiments with Text Understanding 10 Jan 2021 · 1 repository · arXiv:2101.03453
-
Channel Boosting Feature Ensemble for Radar-based Object Detection 10 Jan 2021 · 0 repositories · arXiv:2101.03531
-
Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualized Embeddings 10 Jan 2021 · 1 repository · arXiv:2101.11422
-
Deep Reinforcement Learning with Function Properties in Mean Reversion Strategies 9 Jan 2021 · 1 repository · arXiv:2101.03418
-
Learning Better Sentence Representation with Syntax Information 9 Jan 2021 · 0 repositories · arXiv:2101.03343
-
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing 9 Jan 2021 · 1 repository · arXiv:2101.03289
-
Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search 8 Jan 2021 · 2 repositories · arXiv:2101.03036
-
Leveraging Multilingual Transformers for Hate Speech Detection 8 Jan 2021 · 1 repository · arXiv:2101.03207
-
Misspelling Correction with Pre-trained Contextual Language Model 8 Jan 2021 · 0 repositories · arXiv:2101.03204
-
Applying Transfer Learning for Improving Domain-Specific Search Experience Using Query to Question Similarity 7 Jan 2021 · 0 repositories · arXiv:2101.02351
-
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs 7 Jan 2021 · 5 repositories · arXiv:2101.02402Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples)
-
Detecting Log Anomalies with Multi-Head Attention (LAMA) 7 Jan 2021 · 0 repositories · arXiv:2101.02392
-
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English 7 Jan 2021 · 1 repository · arXiv:2101.02359
-
Homonym Identification using BERT -- Using a Clustering Approach 7 Jan 2021 · 0 repositories · arXiv:2101.02398
-
TrackFormer: Multi-Object Tracking with Transformers 7 Jan 2021 · 2 repositories · arXiv:2101.02702
-
Transformer-based approach towards music emotion recognition from lyrics 6 Jan 2021 · 1 repository · arXiv:2101.02051
-
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks 5 Jan 2021 · 1 repository · arXiv:2101.01761
-
COVID-19: Comparative Analysis of Methods for Identifying Articles Related to Therapeutics and Vaccines without Using Labeled Data 5 Jan 2021 · 0 repositories · arXiv:2101.02017
-
I-BERT: Integer-only BERT Quantization 5 Jan 2021 · 7 repositories · arXiv:2101.01321
-
Improving reference mining in patents with BERT 4 Jan 2021 · 1 repository · arXiv:2101.01039
-
Improving Portuguese Semantic Role Labeling with Transformers and Transfer Learning 4 Jan 2021 · 1 repository · arXiv:2101.01213
-
Transformers in Vision: A Survey 4 Jan 2021 · 0 repositories · arXiv:2101.01169
-
Using BART to Perform Pareto Optimization and Quantify its Uncertainties 4 Jan 2021 · 0 repositories · arXiv:2101.02558
-
An Efficient Transformer Decoder with Compressed Sub-layers 3 Jan 2021 · 0 repositories · arXiv:2101.00542
-
A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition 2 Jan 2021 · 1 repository · arXiv:2101.00388
-
CDLM: Cross-Document Language Modeling 2 Jan 2021 · 2 repositories · arXiv:2101.00406
-
End-to-End Training of Neural Retrievers for Open-Domain Question Answering 2 Jan 2021 · 2 repositories · arXiv:2101.00408
-
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting 2 Jan 2021 · 1 repository · arXiv:2101.00416
-
KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation 2 Jan 2021 · 1 repository · arXiv:2101.00419
-
Lex-BERT: Enhancing BERT based NER with lexicons 2 Jan 2021 · 0 repositories · arXiv:2101.00396
-
Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words 2 Jan 2021 · 1 repository · arXiv:2101.00403Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure 2 Jan 2021 · 0 repositories · arXiv:2101.00387
-
Learning to Generate Task-Specific Adapters from Task Description 2 Jan 2021 · 1 repository · arXiv:2101.00420
-
Adding Recurrence to Pretrained Transformers 1 Jan 2021 · 0 repositories
-
Analogical Reasoning for Visually Grounded Compositional Generalization 1 Jan 2021 · 0 repositories
-
AriEL: Volume Coding for Sentence Generation Comparisons 1 Jan 2021 · 0 repositories
-
Attention Is Not Enough: Mitigating the Distribution Discrepancy in Asynchronous Multimodal Sequence Fusion 1 Jan 2021 · 0 repositories
-
Block Skim Transformer for Efficient Question Answering 1 Jan 2021 · 0 repositories
-
BROS: A Pre-trained Language Model for Understanding Texts in Document 1 Jan 2021 · 0 repositories
-
Causal Probabilistic Spatio-temporal Fusion Transformers in Two-sided Ride-Hailing Markets 1 Jan 2021 · 0 repositories
-
Cluster-Former: Clustering-based Sparse Transformer for Question Answering 1 Jan 2021 · 0 repositories