Methods › General › Stochastic Optimization › Adam › Papers, page 233
Adam
Papers archive 2025-07-28
archive papers tagged: 24,390 · with a code link: 10,944 · where Syntology ran a sample: 3,424 (2,899 with a run with no instrument failure, 525 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,424 of 24,390 tagged: 2,899 with a run with no instrument failure, 525 where every run was a failure of Syntology's instrument)
Page 233 of 244: papers 23,201 to 23,300 of 24,390, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
What does BERT Learn from Multiple-Choice Reading Comprehension Datasets? 28 Oct 2019 · 0 repositories · arXiv:1910.12391
-
An Adaptive and Momental Bound Method for Stochastic Learning 27 Oct 2019 · 2 repositories · arXiv:1910.12249Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Word-level Textual Adversarial Attacking as Combinatorial Optimization 27 Oct 2019 · 1 repository · arXiv:1910.12196Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Thieves on Sesame Street! Model Extraction of BERT-based APIs 27 Oct 2019 · 1 repository · arXiv:1910.12366
-
Training ASR models by Generation of Contextual Information 27 Oct 2019 · 0 repositories · arXiv:1910.12367
-
DENS: A Dataset for Multi-class Emotion Analysis 25 Oct 2019 · 0 repositories · arXiv:1910.11769
-
HUBERT Untangles BERT to Improve Transfer across NLP Tasks 25 Oct 2019 · 1 repository · arXiv:1910.12647
-
L2RS: A Learning-to-Rescore Mechanism for Automatic Speech Recognition 25 Oct 2019 · 0 repositories · arXiv:1910.11496
-
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders 25 Oct 2019 · 7 repositories · arXiv:1910.12638Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
On the Cross-lingual Transferability of Monolingual Representations 25 Oct 2019 · 7 repositories · arXiv:1910.11856Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Optimizer Benchmarking Needs to Account for Hyperparameter Tuning 25 Oct 2019 · 0 repositories · arXiv:1910.11758
-
SpeechBERT: An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering 25 Oct 2019 · 0 repositories · arXiv:1910.11559
-
Towards Online End-to-end Transformer Automatic Speech Recognition 25 Oct 2019 · 0 repositories · arXiv:1910.11871
-
An Empirical Study of Efficient ASR Rescoring with Transformers 24 Oct 2019 · 0 repositories · arXiv:1910.11450
-
Combining Acoustics, Content and Interaction Features to Find Hot Spots in Meetings 24 Oct 2019 · 0 repositories · arXiv:1910.10869
-
ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit 24 Oct 2019 · 3 repositories · arXiv:1910.10909Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Promoting the Knowledge of Source Syntax in Transformer NMT Is Not Needed 24 Oct 2019 · 0 repositories · arXiv:1910.11218
-
A Transformer with Interleaved Self-attention and Convolution for Hybrid Acoustic Models 23 Oct 2019 · 1 repository · arXiv:1910.10352
-
Controlling the Output Length of Neural Machine Translation 23 Oct 2019 · 0 repositories · arXiv:1910.10408
-
Correction of Automatic Speech Recognition with Transformer Sequence-to-sequence Model 23 Oct 2019 · 0 repositories · arXiv:1910.10697
-
Deja-vu: Double Feature Presentation and Iterated Loss in Deep Transformer Networks 23 Oct 2019 · 2 repositories · arXiv:1910.10324
-
Emergent Properties of Finetuned Language Representation Models 23 Oct 2019 · 0 repositories · arXiv:1910.10832
-
Hierarchical Transformers for Long Document Classification 23 Oct 2019 · 3 repositories · arXiv:1910.10781
-
Relation Module for Non-answerable Prediction on Question Answering 23 Oct 2019 · 0 repositories · arXiv:1910.10843
-
Speech-XLNet: Unsupervised Acoustic Model Pretraining For Self-Attention Networks 23 Oct 2019 · 0 repositories · arXiv:1910.10387
-
TCT: A Cross-supervised Learning Method for Multimodal Sequence Representation 23 Oct 2019 · 0 repositories · arXiv:1911.05186
-
An Efficient and Effective Second-Order Training Algorithm for LSTM-based Adaptive Learning 22 Oct 2019 · 1 repository · arXiv:1910.09857
-
Complex Transformer: A Framework for Modeling Complex-Valued Sequence 22 Oct 2019 · 1 repository · arXiv:1910.10202Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Exchangeable deep neural networks for set-to-set matching and learning 22 Oct 2019 · 2 repositories · arXiv:1910.09972
-
Depth-Adaptive Transformer 22 Oct 2019 · 0 repositories · arXiv:1910.10073
-
Improving Transformer-based Speech Recognition Using Unsupervised Pre-training 22 Oct 2019 · 1 repository · arXiv:1910.09932
-
MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension 22 Oct 2019 · 1 repository · arXiv:1910.09753Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Sequence-to-sequence Singing Synthesis Using the Feed-forward Transformer 22 Oct 2019 · 0 repositories · arXiv:1910.09989
-
Transformer-based Acoustic Modeling for Hybrid Speech Recognition 22 Oct 2019 · 0 repositories · arXiv:1910.09799
-
Implementation of a modified Nesterov's Accelerated quasi-Newton Method on Tensorflow 21 Oct 2019 · 0 repositories · arXiv:1910.09158
-
Learning to Make Generalizable and Diverse Predictions for Retrosynthesis 21 Oct 2019 · 0 repositories · arXiv:1910.09688
-
Transformer-CNN: Fast and Reliable tool for QSAR 21 Oct 2019 · 1 repository · arXiv:1911.06603
-
Personalized Graph Neural Networks with Attention Mechanism for Session-Aware Recommendation 20 Oct 2019 · 3 repositories · arXiv:1910.08887
-
Targeted Estimation of Heterogeneous Treatment Effect in Observational Survival Analysis 20 Oct 2019 · 1 repository · arXiv:1910.08877
-
MonaLog: a Lightweight System for Natural Language Inference Based on Monotonicity 19 Oct 2019 · 1 repository · arXiv:1910.08772
-
XL-Editor: Post-editing Sentences with XLNet 19 Oct 2019 · 0 repositories · arXiv:1910.10479
-
A Mutual Information Maximization Perspective of Language Representation Learning 18 Oct 2019 · 0 repositories · arXiv:1910.08350
-
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System 18 Oct 2019 · 0 repositories · arXiv:1910.08381
-
Robust Learning Rate Selection for Stochastic Optimization via Splitting Diagnostic 18 Oct 2019 · 0 repositories · arXiv:1910.08597
-
BIG MOOD: Relating Transformers to Explicit Commonsense Knowledge 17 Oct 2019 · 0 repositories · arXiv:1910.07713
-
Fully Quantized Transformer for Machine Translation 17 Oct 2019 · 0 repositories · arXiv:1910.10485
-
Measuring semantic similarity of clinical trial outcomes using deep pre-trained language representations 17 Oct 2019 · 0 repositories
-
Predicting retrosynthetic pathways using a combined linguistic model and hyper-graph exploration strategy 17 Oct 2019 · 0 repositories · arXiv:1910.08036
-
Question Classification with Deep Contextualized Transformer 17 Oct 2019 · 1 repository · arXiv:1910.10492
-
Universal Text Representation from BERT: An Empirical Study 17 Oct 2019 · 0 repositories · arXiv:1910.07973
-
BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Model Performance 16 Oct 2019 · 1 repository · arXiv:1910.07181Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Bridging the Knowledge Gap: Enhancing Question Answering with World and Domain Knowledge 16 Oct 2019 · 0 repositories · arXiv:1910.07429
-
Efficiency through Auto-Sizing: Notre Dame NLP's Submission to the WNGT 2019 Efficiency Task 16 Oct 2019 · 0 repositories · arXiv:1910.07134
-
Evolution of transfer learning in natural language processing 16 Oct 2019 · 0 repositories · arXiv:1910.07370
-
Imperial College London Submission to VATEX Video Captioning Task 16 Oct 2019 · 0 repositories · arXiv:1910.07482
-
Injecting Hierarchy with U-Net Transformers 16 Oct 2019 · 2 repositories · arXiv:1910.10488
-
Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models 16 Oct 2019 · 0 repositories · arXiv:1910.07117
-
Transformer ASR with Contextual Block Processing 16 Oct 2019 · 0 repositories · arXiv:1910.07204
-
Using Whole Document Context in Neural Machine Translation 16 Oct 2019 · 0 repositories · arXiv:1910.07481
-
Aligning Cross-Lingual Entities with Multi-Aspect Information 15 Oct 2019 · 1 repository · arXiv:1910.06575
-
Answering Complex Open-domain Questions Through Iterative Query Generation 15 Oct 2019 · 1 repository · arXiv:1910.07000Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving 15 Oct 2019 · 3 repositories · arXiv:1910.06611Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
-
Facebook AI's WAT19 Myanmar-English Translation Task Submission 15 Oct 2019 · 0 repositories · arXiv:1910.06848
-
On Higher-order Moments in Adam 15 Oct 2019 · 0 repositories · arXiv:1910.06878
-
Structured Pruning of a BERT-based Question Answering Model 14 Oct 2019 · 0 repositories · arXiv:1910.06360
-
Q8BERT: Quantized 8Bit BERT 14 Oct 2019 · 5 repositories · arXiv:1910.06188Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
STANCY: Stance Classification Based on Consistency Cues 14 Oct 2019 · 1 repository · arXiv:1910.06048
-
Transformers without Tears: Improving the Normalization of Self-Attention 14 Oct 2019 · 5 repositories · arXiv:1910.05895Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Whatcha lookin' at? DeepLIFTing BERT's Attention in Question Answering 14 Oct 2019 · 1 repository · arXiv:1910.06431
-
Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT 13 Oct 2019 · 0 repositories · arXiv:1910.05786
-
Stabilizing Transformers for Reinforcement Learning 13 Oct 2019 · 5 repositories · arXiv:1910.06764Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
On Robustness of Neural Ordinary Differential Equations 12 Oct 2019 · 2 repositories · arXiv:1910.05513Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations 12 Oct 2019 · 3 repositories · arXiv:1910.05453Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Automatic segmentation of texts into units of meaning for reading assistance 11 Oct 2019 · 0 repositories · arXiv:1910.05014
-
BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novels 11 Oct 2019 · 1 repository · arXiv:1910.05040
-
Demon: Improved Neural Network Training with Momentum Decay 11 Oct 2019 · 2 repositories · arXiv:1910.04952
-
exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models 11 Oct 2019 · 1 repository · arXiv:1910.05276
-
On Empirical Comparisons of Optimizers for Deep Learning 11 Oct 2019 · 2 repositories · arXiv:1910.05446
-
Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework 10 Oct 2019 · 2 repositories · arXiv:1910.04708
-
FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams 10 Oct 2019 · 3 repositories · arXiv:1910.04345
-
A cost-effective method for improving and re-purposing large, pre-trained GANs by fine-tuning their class-embeddings 10 Oct 2019 · 1 repository · arXiv:1910.04760
-
Multi-label Categorization of Accounts of Sexism using a Neural Framework 10 Oct 2019 · 1 repository · arXiv:1910.04602
-
Multilingual Question Answering from Formatted Text applied to Conversational Agents 10 Oct 2019 · 0 repositories · arXiv:1910.04659
-
On Recognizing Texts of Arbitrary Shapes with 2D Self-Attention 10 Oct 2019 · 2 repositories · arXiv:1910.04396
-
Structured Pruning of Large Language Models 10 Oct 2019 · 2 repositories · arXiv:1910.04732Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 2 pointer-only (licence)
-
Visual Natural Language Query Auto-Completion for Estimating Instance Probabilities 10 Oct 2019 · 1 repository · arXiv:1910.04887
-
A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification 9 Oct 2019 · 0 repositories · arXiv:1910.04176
-
Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models 9 Oct 2019 · 1 repository · arXiv:1910.03756
-
Ctrl-Z: Recovering from Instability in Reinforcement Learning 9 Oct 2019 · 0 repositories · arXiv:1910.03732
-
Is Multilingual BERT Fluent in Language Generation? 9 Oct 2019 · 1 repository · arXiv:1910.03806
-
On the adequacy of untuned warmup for adaptive optimization 9 Oct 2019 · 1 repository · arXiv:1910.04209Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
PipeMare: Asynchronous Pipeline Parallel DNN Training 9 Oct 2019 · 0 repositories · arXiv:1910.05124
-
HuggingFace's Transformers: State-of-the-art Natural Language Processing 9 Oct 2019 · 9 repositories · arXiv:1910.03771Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Knowledge Distillation from Internal Representations 8 Oct 2019 · 0 repositories · arXiv:1910.03723
-
MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis 8 Oct 2019 · 21 repositories · arXiv:1910.06711Syntology official (archive's flag): 1 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
SesameBERT: Attention for Anywhere 8 Oct 2019 · 0 repositories · arXiv:1910.03176
-
BERT for Evidence Retrieval and Claim Verification 7 Oct 2019 · 2 repositories · arXiv:1910.02655Syntology 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Parallel Iterative Edit Models for Local Sequence Transduction 7 Oct 2019 · 1 repository · arXiv:1910.02893
-
SMArT: Training Shallow Memory-aware Transformers for Robotic Explainability 7 Oct 2019 · 0 repositories · arXiv:1910.02974
-
Named Entity Recognition -- Is there a glass ceiling? 6 Oct 2019 · 1 repository · arXiv:1910.02403