Methods › General › Large Batch Optimization › Adafactor › Papers, page 5

Adafactor

Papers archive 2025-07-28

archive papers tagged: 733 · with a code link: 363 · where Syntology ran a sample: 103 (89 with a run with no instrument failure, 14 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (103 of 733 tagged: 89 with a run with no instrument failure, 14 where every run was a failure of Syntology's instrument)

Page 5 of 8: papers 401 to 500 of 733, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• FLAME: A small language model for spreadsheet formulas
  31 Jan 2023 · 0 repositories · arXiv:2301.13779
• The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
  31 Jan 2023 · 1 repository · arXiv:2301.13688
• Specializing Smaller Language Models towards Multi-Step Reasoning
  30 Jan 2023 · 2 repositories · arXiv:2301.12726
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Progressive Prompts: Continual Learning for Language Models
  29 Jan 2023 · 2 repositories · arXiv:2301.12314
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
• Schema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation
  29 Jan 2023 · 1 repository · arXiv:2301.12568
• Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark Datasets
  28 Jan 2023 · 2 repositories · arXiv:2301.12139
• A Stability Analysis of Fine-Tuning a Pre-Trained Model
  24 Jan 2023 · 0 repositories · arXiv:2301.09820
• Multitask Instruction-based Prompting for Fallacy Recognition
  24 Jan 2023 · 0 repositories · arXiv:2301.09992
• Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
  18 Jan 2023 · 1 repository · arXiv:2301.07507
• There is No Big Brother or Small Brother: Knowledge Infusion in Language Models for Link Prediction and Question Answering
  10 Jan 2023 · 2 repositories · arXiv:2301.04013
• Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model
  6 Jan 2023 · 0 repositories · arXiv:2301.02748
• Extending Source Code Pre-Trained Language Models to Summarise Decompiled Binaries
  4 Jan 2023 · 1 repository · arXiv:2301.01701
• Transformer Based Geocoding
  2 Jan 2023 · 0 repositories · arXiv:2301.01170
• Inconsistencies in Masked Language Models
  30 Dec 2022 · 1 repository · arXiv:2301.00068
• Error syntax aware augmentation of feedback comment generation dataset
  29 Dec 2022 · 0 repositories · arXiv:2212.14293
• Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models
  21 Dec 2022 · 1 repository · arXiv:2212.10769
• ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models
  20 Dec 2022 · 1 repository · arXiv:2212.10474
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Do language models have coherent mental models of everyday things?
  20 Dec 2022 · 1 repository · arXiv:2212.10029
  Syntology official: harvested, nothing ran · 0 ran · 5 unverified (of 5 harvested samples)
• KronA: Parameter Efficient Tuning with Kronecker Adapter
  20 Dec 2022 · 0 repositories · arXiv:2212.10650
• Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis
  20 Dec 2022 · 0 repositories · arXiv:2212.10356
• T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks
  20 Dec 2022 · 2 repositories · arXiv:2212.10548
• Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
  19 Dec 2022 · 1 repository · arXiv:2212.09747
• MIGA: A Unified Multi-task Generation Framework for Conversational Text-to-SQL
  19 Dec 2022 · 0 repositories · arXiv:2212.09278
• Mu²SLAM: Multitask, Multilingual Speech and Language Models
  19 Dec 2022 · 0 repositories · arXiv:2212.09553
• Multilingual Sequence-to-Sequence Models for Hebrew NLP
  19 Dec 2022 · 0 repositories · arXiv:2212.09682
• LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension
  16 Dec 2022 · 0 repositories · arXiv:2212.08204
• Teaching Small Language Models to Reason
  16 Dec 2022 · 0 repositories · arXiv:2212.08410
• FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
  15 Dec 2022 · 0 repositories · arXiv:2212.08153
• Visually-augmented pretrained language models for NLP tasks without images
  15 Dec 2022 · 1 repository · arXiv:2212.07937
• Evaluating Byte and Wordpiece Level Models for Massively Multilingual Semantic Parsing
  14 Dec 2022 · 0 repositories · arXiv:2212.07223
• T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics
  12 Dec 2022 · 2 repositories · arXiv:2212.05726
• Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
  9 Dec 2022 · 1 repository · arXiv:2212.05055
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• TRBLLmaker -- Transformer Reads Between Lyrics Lines maker
  9 Dec 2022 · 0 repositories · arXiv:2212.04917
• Hierarchical multimodal transformers for Multi-Page DocVQA
  7 Dec 2022 · 1 repository · arXiv:2212.05935
• Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AI
  6 Dec 2022 · 0 repositories · arXiv:2212.02924
• Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer
  4 Dec 2022 · 0 repositories · arXiv:2212.01757
• Global memory transformer for processing long documents
  3 Dec 2022 · 0 repositories · arXiv:2212.01650
• FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecasting
  2 Dec 2022 · 1 repository · arXiv:2212.01209
• Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
  1 Dec 2022 · 1 repository · arXiv:2212.00196
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
• Detect-Localize-Repair: A Unified Framework for Learning to Debug with CodeT5
  27 Nov 2022 · 0 repositories · arXiv:2211.14875
• Coreference Resolution through a seq2seq Transition-Based System
  22 Nov 2022 · 1 repository · arXiv:2211.12142
• HyperTuning: Toward Adapting Large Language Models without Back-propagation
  22 Nov 2022 · 0 repositories · arXiv:2211.12485
• Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inference
  21 Nov 2022 · 0 repositories · arXiv:2211.11875
• UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning
  20 Nov 2022 · 0 repositories · arXiv:2211.10986
• GLAMI-1M: A Multilingual Image-Text Fashion Dataset
  17 Nov 2022 · 1 repository · arXiv:2211.14451
• Unified Question Answering in Slovene
  16 Nov 2022 · 1 repository · arXiv:2211.09159
• Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs
  15 Nov 2022 · 1 repository · arXiv:2211.07950
  Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
• Empowering Language Models with Knowledge Graph Reasoning for Question Answering
  15 Nov 2022 · 0 repositories · arXiv:2211.08380
• CST5: Data Augmentation for Code-Switched Semantic Parsing
  14 Nov 2022 · 1 repository · arXiv:2211.07514
• Technological taxonomies for hypernym and hyponym retrieval in patent texts
  14 Nov 2022 · 1 repository · arXiv:2212.06039
• DocuT5: Seq2seq SQL Generation with Table Documentation
  11 Nov 2022 · 0 repositories · arXiv:2211.06193
• Assistive Completion of Agrammatic Aphasic Sentences: A Transfer Learning Approach using Neurolinguistics-based Synthetic Dataset
  10 Nov 2022 · 0 repositories · arXiv:2211.05557
• Large Language Models with Controllable Working Memory
  9 Nov 2022 · 0 repositories · arXiv:2211.05110
• Conciseness: An Overlooked Language Task
  8 Nov 2022 · 0 repositories · arXiv:2211.04126
• Crosslingual Generalization through Multitask Finetuning
  3 Nov 2022 · 1 repository · arXiv:2211.01786
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
• Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device
  3 Nov 2022 · 0 repositories · arXiv:2212.01217
• eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
  2 Nov 2022 · 2 repositories · arXiv:2211.01324
  Syntology 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples)
• FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness
  1 Nov 2022 · 0 repositories · arXiv:2211.00294
• Two-stage LLM Fine-tuning with Less Specialization and More Generalization
  1 Nov 2022 · 0 repositories · arXiv:2211.00635
• T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5
  1 Nov 2022 · 1 repository · arXiv:2211.00586
• Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
  26 Oct 2022 · 0 repositories · arXiv:2210.14867
• Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding
  26 Oct 2022 · 1 repository · arXiv:2210.14486
• Amos: An Adam-style Optimizer with Adaptive Weight Decay towards Model-Oriented Scale
  21 Oct 2022 · 1 repository · arXiv:2210.11693
  Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples)
• Decoding a Neural Retriever's Latent Space for Query Suggestion
  21 Oct 2022 · 1 repository · arXiv:2210.12084
• SLING: Sino Linguistic Evaluation of Large Language Models
  21 Oct 2022 · 1 repository · arXiv:2210.11689
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
• Scaling Instruction-Finetuned Language Models
  20 Oct 2022 · 9 repositories · arXiv:2210.11416
  Syntology 8 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 9 unverified (of 17 harvested samples) · 2 pointer-only (licence)
• Self-supervised Graph Masking Pre-training for Graph-to-Text Generation
  19 Oct 2022 · 1 repository · arXiv:2210.10599
• Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generation
  18 Oct 2022 · 0 repositories · arXiv:2210.09549
• "John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility
  14 Oct 2022 · 1 repository · arXiv:2210.07471
• Self-Repetition in Abstractive Neural Summarizers
  14 Oct 2022 · 0 repositories · arXiv:2210.08145
• Tone prediction and orthographic conversion for Basaa
  13 Oct 2022 · 0 repositories · arXiv:2210.06986
• Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding
  12 Oct 2022 · 2 repositories · arXiv:2210.06444
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis
  12 Oct 2022 · 1 repository · arXiv:2210.06629
• RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses
  12 Oct 2022 · 0 repositories · arXiv:2210.10634
• Are Pretrained Multilingual Models Equally Fair Across Languages?
  11 Oct 2022 · 1 repository · arXiv:2210.05457
• Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems
  11 Oct 2022 · 0 repositories · arXiv:2210.05075
• T5 for Hate Speech, Augmented Data and Ensemble
  11 Oct 2022 · 1 repository · arXiv:2210.05480
• ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Models
  9 Oct 2022 · 1 repository · arXiv:2210.04325
• CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation Models
  9 Oct 2022 · 1 repository · arXiv:2210.04191
• Better Pre-Training by Reducing Representation Confusion
  9 Oct 2022 · 0 repositories · arXiv:2210.04246
• Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering
  7 Oct 2022 · 0 repositories · arXiv:2210.03427
• How Large Language Models are Transforming Machine-Paraphrased Plagiarism
  7 Oct 2022 · 3 repositories · arXiv:2210.03568
• LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Models
  7 Oct 2022 · 1 repository · arXiv:2210.03696
• LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddings
  1 Oct 2022 · 2 repositories · arXiv:2210.00305
• Bidirectional Language Models Are Also Few-shot Learners
  29 Sep 2022 · 0 repositories · arXiv:2209.14500
• WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphs
  27 Sep 2022 · 1 repository · arXiv:2209.13101
• Application of Deep Learning in Generating Structured Radiology Reports: A Transformer-Based Technique
  25 Sep 2022 · 1 repository · arXiv:2209.12177
• ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension
  23 Sep 2022 · 1 repository · arXiv:2209.11484
• XF2T: Cross-lingual Fact-to-Text Generation for Low-Resource Languages
  22 Sep 2022 · 0 repositories · arXiv:2209.11252
• T5QL: Taming language models for SQL generation
  21 Sep 2022 · 0 repositories · arXiv:2209.10254
• Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech
  11 Sep 2022 · 0 repositories · arXiv:2209.04889
• Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models
  10 Sep 2022 · 0 repositories · arXiv:2209.04683
• IDIAPers @ Causal News Corpus 2022: Extracting Cause-Effect-Signal Triplets via Pre-trained Autoregressive Language Model
  8 Sep 2022 · 1 repository · arXiv:2209.03891
• MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages
  27 Aug 2022 · 1 repository · arXiv:2208.13078
• AutoQGS: Auto-Prompt for Low-Resource Knowledge-based Question Generation from SPARQL
  26 Aug 2022 · 1 repository · arXiv:2208.12461
• Training a T5 Using Lab-sized Resources
  25 Aug 2022 · 0 repositories · arXiv:2208.12097
• Diverse Title Generation for Stack Overflow Posts with Multiple Sampling Enhanced Transformer
  24 Aug 2022 · 1 repository · arXiv:2208.11523
• MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue Generation
  18 Aug 2022 · 1 repository · arXiv:2208.08629
• Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models
  17 Aug 2022 · 0 repositories · arXiv:2208.08408
• Continuous Active Learning Using Pretrained Transformers
  15 Aug 2022 · 0 repositories · arXiv:2208.06955