Methods › General › Stochastic Optimization › Adam › Papers, page 228

Adam

Papers archive 2025-07-28

archive papers tagged: 24,390 · with a code link: 10,944 · where Syntology ran a sample: 3,424 (2,899 with a run with no instrument failure, 525 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,424 of 24,390 tagged: 2,899 with a run with no instrument failure, 525 where every run was a failure of Syntology's instrument)

Page 228 of 244: papers 22,701 to 22,800 of 24,390, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• A Primer in BERTology: What we know about how BERT works
  27 Feb 2020 · 0 repositories · arXiv:2002.12327
• Adv-BERT: BERT is not robust on misspellings! Generating nature adversarial samples on BERT
  27 Feb 2020 · 0 repositories · arXiv:2003.04985
• Compressing Large-Scale Transformer-Based Models: A Case Study on BERT
  27 Feb 2020 · 0 repositories · arXiv:2002.11985
• Marathi To English Neural Machine Translation With Near Perfect Corpus And Transformers
  26 Feb 2020 · 1 repository · arXiv:2002.11643
• Multi-task Learning with Multi-head Attention for Multi-choice Reading Comprehension
  26 Feb 2020 · 0 repositories · arXiv:2003.04992
• Sparse Sinkhorn Attention
  26 Feb 2020 · 1 repository · arXiv:2002.11296
• Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers
  26 Feb 2020 · 2 repositories · arXiv:2002.11794
• MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
  25 Feb 2020 · 1 repository · arXiv:2002.10957
• What BERT Sees: Cross-Modal Transfer for Visual Question Generation
  25 Feb 2020 · 0 repositories · arXiv:2002.10832
• Exploring BERT Parameter Efficiency on the Stanford Question Answering Dataset v2.0
  25 Feb 2020 · 0 repositories · arXiv:2002.10670
• Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation
  24 Feb 2020 · 0 repositories · arXiv:2002.10260
• GRET: Global Representation Enhanced Transformer
  24 Feb 2020 · 0 repositories · arXiv:2002.10101
• Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation
  24 Feb 2020 · 1 repository · arXiv:2002.10345
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Predicting Subjective Features of Questions of QA Websites using BERT
  24 Feb 2020 · 5 repositories · arXiv:2002.10107
• Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent
  24 Feb 2020 · 1 repository · arXiv:2002.10583
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Sketchformer: Transformer-based Representation for Sketched Structure
  24 Feb 2020 · 1 repository · arXiv:2002.10381
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Training Question Answering Models From Synthetic Data
  22 Feb 2020 · 0 repositories · arXiv:2002.09599
• Addressing Some Limitations of Transformers with Feedback Memory
  21 Feb 2020 · 4 repositories · arXiv:2002.09402
  Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
• Learning Dynamic Belief Graphs to Generalize on Text-Based Games
  21 Feb 2020 · 1 repository · arXiv:2002.09127
• Transformer Hawkes Process
  21 Feb 2020 · 3 repositories · arXiv:2002.09291
  Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Federated pretraining and fine tuning of BERT using clinical notes from multiple silos
  20 Feb 2020 · 0 repositories · arXiv:2002.08562
• Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning
  19 Feb 2020 · 1 repository · arXiv:2002.08307
• LAMBERT: Layout-Aware (Language) Modeling for information extraction
  19 Feb 2020 · 1 repository · arXiv:2002.08087
• Molecule Attention Transformer
  19 Feb 2020 · 7 repositories · arXiv:2002.08264
  Syntology official (archive's flag): 2 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 3 pointer-only (licence)
• The Geometry of Sign Gradient Descent
  19 Feb 2020 · 0 repositories · arXiv:2002.08056
• The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  19 Feb 2020 · 3 repositories · arXiv:2002.07972
• Towards Making the Most of Context in Neural Machine Translation
  19 Feb 2020 · 1 repository · arXiv:2002.07982
• Tree-structured Attention with Hierarchical Accumulation
  19 Feb 2020 · 0 repositories · arXiv:2002.08046
• Conditional Self-Attention for Query-based Summarization
  18 Feb 2020 · 0 repositories · arXiv:2002.07338
• From English To Foreign Languages: Transferring Pre-trained Language Models
  18 Feb 2020 · 1 repository · arXiv:2002.07306
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Gradient-Based Adversarial Training on Transformer Networks for Detecting Check-Worthy Factual Claims
  18 Feb 2020 · 1 repository · arXiv:2002.07725
• Hierarchical Transformer Network for Utterance-level Emotion Recognition
  18 Feb 2020 · 0 repositories · arXiv:2002.07551
• Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
  18 Feb 2020 · 3 repositories · arXiv:2002.07510
  Syntology official: not harvested · 0 ran · 5 unverified (of 5 harvested samples) · 5 pointer-only (licence)
• Uncertainty Estimation in Autoregressive Structured Prediction
  18 Feb 2020 · 1 repository · arXiv:2002.07650
• A Financial Service Chatbot based on Deep Bidirectional Transformers
  17 Feb 2020 · 0 repositories · arXiv:2003.04987
• Adaptive Experience Selection for Policy Gradient
  17 Feb 2020 · 0 repositories · arXiv:2002.06946
• Controlling Computation versus Quality for Neural Sequence Models
  17 Feb 2020 · 0 repositories · arXiv:2002.07106
• Incorporating BERT into Neural Machine Translation
  17 Feb 2020 · 3 repositories · arXiv:2002.06823
• Low-Rank Bottleneck in Multi-head Attention Models
  17 Feb 2020 · 0 repositories · arXiv:2002.07028
• Multi-layer Representation Fusion for Neural Machine Translation
  16 Feb 2020 · 1 repository · arXiv:2002.06714
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Neural Machine Translation with Joint Representation
  16 Feb 2020 · 1 repository · arXiv:2002.06546
• SBERT-WK: A Sentence Embedding Method by Dissecting BERT-based Word Models
  16 Feb 2020 · 3 repositories · arXiv:2002.06652
• The Utility of General Domain Transfer Learning for Medical Language Tasks
  16 Feb 2020 · 0 repositories · arXiv:2002.06670
• Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
  15 Feb 2020 · 4 repositories · arXiv:2002.06305
• Non-asymptotic Convergence of Adam-type Reinforcement Learning Algorithms under Markovian Sampling
  15 Feb 2020 · 0 repositories · arXiv:2002.06286
• Small energy masking for improved neural network training for end-to-end speech recognition
  15 Feb 2020 · 0 repositories · arXiv:2002.06312
• UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation
  15 Feb 2020 · 2 repositories · arXiv:2002.06353
  Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 1 pointer-only (licence)
• Deep Attentive Study Session Dropout Prediction in Mobile Learning Environment
  14 Feb 2020 · 0 repositories · arXiv:2002.11624
• FQuAD: French Question Answering Dataset
  14 Feb 2020 · 0 repositories · arXiv:2002.06071
• Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks
  14 Feb 2020 · 0 repositories · arXiv:2002.06261
• Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing
  14 Feb 2020 · 5 repositories · arXiv:2002.07033
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Transformer on a Diet
  14 Feb 2020 · 1 repository · arXiv:2002.06170
• TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
  14 Feb 2020 · 2 repositories · arXiv:2002.06275
• Understanding patient complaint characteristics using contextual clinical BERT embeddings
  14 Feb 2020 · 0 repositories · arXiv:2002.05902
• CBAG: Conditional Biomedical Abstract Generation
  13 Feb 2020 · 0 repositories · arXiv:2002.05637
• Sparse and Structured Visual Attention
  13 Feb 2020 · 1 repository · arXiv:2002.05556
• Training Large Neural Networks with Constant Memory using a New Execution Algorithm
  13 Feb 2020 · 2 repositories · arXiv:2002.05645
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Attentional Speech Recognition Models Misbehave on Out-of-domain Utterances
  12 Feb 2020 · 1 repository · arXiv:2002.05150
• End-to-End Face Parsing via Interlinked Convolutional Neural Networks
  12 Feb 2020 · 1 repository · arXiv:2002.04831
• A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance
  12 Feb 2020 · 2 repositories · arXiv:2002.05273
• GLU Variants Improve Transformer
  12 Feb 2020 · 27 repositories · arXiv:2002.05202
  Syntology 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 4 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 7 pointer-only (licence)
• LaProp: Separating Momentum and Adaptivity in Adam
  12 Feb 2020 · 2 repositories · arXiv:2002.04839
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models
  12 Feb 2020 · 0 repositories · arXiv:2002.05058
• On Layer Normalization in the Transformer Architecture
  12 Feb 2020 · 9 repositories · arXiv:2002.04745
  Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
• Utilizing BERT Intermediate Layers for Aspect Based Sentiment Analysis and Natural Language Inference
  12 Feb 2020 · 1 repository · arXiv:2002.04815
• Improved Consistency Regularization for GANs
  11 Feb 2020 · 0 repositories · arXiv:2002.04724
• Optimal Transfer Learning Model for Binary Classification of Funduscopic Images through Simple Heuristics
  11 Feb 2020 · 0 repositories · arXiv:2002.04189
• Superbloom: Bloom filter meets Transformer
  11 Feb 2020 · 0 repositories · arXiv:2002.04723
• Training with Streaming Annotation
  11 Feb 2020 · 0 repositories · arXiv:2002.04165
• Deep Representation Learning for Dynamical Systems Modeling
  10 Feb 2020 · 0 repositories · arXiv:2002.05111
• End-to-End Multi-speaker Speech Recognition with Transformer
  10 Feb 2020 · 0 repositories · arXiv:2002.03921
• Multilingual Alignment of Contextual Word Representations
  10 Feb 2020 · 1 repository · arXiv:2002.03518
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Pre-training Tasks for Embedding-based Large-scale Retrieval
  10 Feb 2020 · 0 repositories · arXiv:2002.03932
• StickyPillars: Robust and Efficient Feature Matching on Point Clouds using Graph Neural Networks
  10 Feb 2020 · 0 repositories · arXiv:2002.03983
• Application of Pre-training Models in Named Entity Recognition
  9 Feb 2020 · 0 repositories · arXiv:2002.08902
• Momentum Improves Normalized SGD
  9 Feb 2020 · 0 repositories · arXiv:2002.03305
• On the distance between two neural networks and the stability of learning
  9 Feb 2020 · 2 repositories · arXiv:2002.03432
• Blank Language Models
  8 Feb 2020 · 1 repository · arXiv:2002.03079
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
  7 Feb 2020 · 2 repositories · arXiv:2002.02925
  Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• Multimodal Matching Transformer for Live Commenting
  7 Feb 2020 · 0 repositories · arXiv:2002.02649
• Transformer-Capsule Model for Intent Detection
  7 Feb 2020 · 0 repositories
• Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss
  7 Feb 2020 · 5 repositories · arXiv:2002.02562
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
• Few-Shot Learning as Domain Adaptation: Algorithm and Analysis
  6 Feb 2020 · 0 repositories · arXiv:2002.02050
• Introducing Aspects of Creativity in Automatic Poetry Generation
  6 Feb 2020 · 1 repository · arXiv:2002.02511
• perm2vec: Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention
  6 Feb 2020 · 0 repositories · arXiv:2002.02315
• Aligning the Pretraining and Finetuning Objectives of Language Models
  5 Feb 2020 · 0 repositories · arXiv:2002.02000
• K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
  5 Feb 2020 · 2 repositories · arXiv:2002.01808
  Syntology 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 2 pointer-only (licence)
• Rapid Adaptation of BERT for Information Extraction on Domain-Specific Business Documents
  5 Feb 2020 · 1 repository · arXiv:2002.01861
• Vocoder-free End-to-End Voice Conversion with Transformer Network
  5 Feb 2020 · 1 repository · arXiv:2002.03808
• Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform
  4 Feb 2020 · 0 repositories · arXiv:2002.01113
• Interpretable & Time-Budget-Constrained Contextualization for Re-Ranking
  4 Feb 2020 · 1 repository · arXiv:2002.01854
• Learning Long- and Short-Term User Literal-Preference with Multimodal Hierarchical Transformer Network for Personalized Image Caption
  4 Feb 2020 · 0 repositories
• Multistage Model for Robust Face Alignment Using Deep Neural Networks
  4 Feb 2020 · 0 repositories · arXiv:2002.01075
• Bertrand-DR: Improving Text-to-SQL using a Discriminative Re-ranker
  3 Feb 2020 · 1 repository · arXiv:2002.00557
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
  3 Feb 2020 · 1 repository · arXiv:2002.00571
• Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension
  2 Feb 2020 · 1 repository · arXiv:2002.00293
• WaveTTS: Tacotron-based TTS with Joint Time-Frequency Domain Loss
  2 Feb 2020 · 0 repositories · arXiv:2002.00417
• Bridging Text and Video: A Universal Multimodal Transformer for Video-Audio Scene-Aware Dialog
  1 Feb 2020 · 1 repository · arXiv:2002.00163
  Syntology 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Fine-Tuning BERT for Schema-Guided Zero-Shot Dialogue State Tracking
  1 Feb 2020 · 0 repositories · arXiv:2002.00181
• Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions
  1 Feb 2020 · 7 repositories · arXiv:2002.00212