Methods › Natural Language Processing › Autoencoding Transformers › T5 › Papers, page 7

T5

Papers archive 2025-07-28

archive papers tagged: 708 · with a code link: 353 · where Syntology ran a sample: 99 (85 with a run with no instrument failure, 14 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (99 of 708 tagged: 85 with a run with no instrument failure, 14 where every run was a failure of Syntology's instrument)

Page 7 of 8: papers 601 to 700 of 708, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Sharpness-Aware Minimization Improves Language Model Generalization
  16 Oct 2021 · 0 repositories · arXiv:2110.08529
• The Power of Prompt Tuning for Low-Resource Semantic Parsing
  16 Oct 2021 · 0 repositories · arXiv:2110.08525
• LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5
  14 Oct 2021 · 1 repository · arXiv:2110.07298
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples)
• SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing
  14 Oct 2021 · 6 repositories · arXiv:2110.07205
  Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
  8 Oct 2021 · 0 repositories · arXiv:2110.04330
• DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models
  4 Oct 2021 · 1 repository · arXiv:2110.01509
• Perhaps PTLMs Should Go to School -- A Task to Assess Open Book and Closed Book QA
  4 Oct 2021 · 0 repositories · arXiv:2110.01552
• Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models
  1 Oct 2021 · 0 repositories · arXiv:2110.00672
• Scale Efficiently: Insights from Pretraining and Finetuning Transformers
  29 Sep 2021 · 0 repositories
• TransSlowDown: Efficiency Attacks on Neural Machine Translation Systems
  29 Sep 2021 · 0 repositories
• Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
  22 Sep 2021 · 3 repositories · arXiv:2109.10686
  Syntology community repositories only · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 4 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 1 pointer-only (licence)
• Hierarchy-Aware T5 with Path-Adaptive Mask Mechanism for Hierarchical Text Classification
  17 Sep 2021 · 0 repositories · arXiv:2109.08585
• Primer: Searching for Efficient Transformers for Language Modeling
  17 Sep 2021 · 4 repositories · arXiv:2109.08668
  Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Remixers: A Mixer-Transformer Architecture with Compositional Operators for Natural Language Understanding
  17 Sep 2021 · 0 repositories
• Language Models are Few-shot Multilingual Learners
  16 Sep 2021 · 1 repository · arXiv:2109.07684
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
• Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLG
  15 Sep 2021 · 1 repository · arXiv:2109.07043
• Prefix-to-SQL: Text-to-SQL Generation from Incomplete User Questions
  15 Sep 2021 · 0 repositories · arXiv:2109.13066
• Topic Transferable Table Question Answering
  15 Sep 2021 · 1 repository · arXiv:2109.07377
• Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Media
  13 Sep 2021 · 1 repository · arXiv:2109.05815
• Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model
  10 Sep 2021 · 1 repository · arXiv:2109.04672
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
  10 Sep 2021 · 3 repositories · arXiv:2109.05093
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
• Zero-Shot Dialogue State Tracking via Cross-Task Transfer
  10 Sep 2021 · 1 repository · arXiv:2109.04655
• Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models
  8 Sep 2021 · 0 repositories · arXiv:2109.03892
• General-Purpose Question-Answering with Macaw
  6 Sep 2021 · 2 repositories · arXiv:2109.02593
• CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation
  2 Sep 2021 · 5 repositories · arXiv:2109.00859
  Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
• AraT5: Text-to-Text Transformers for Arabic Language Generation
  31 Aug 2021 · 1 repository · arXiv:2109.12068
• Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models
  19 Aug 2021 · 2 repositories · arXiv:2108.08877
• Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models
  18 Aug 2021 · 1 repository · arXiv:2108.08111
• EncT5: Fine-tuning T5 Encoder for Discriminative Tasks
  17 Aug 2021 · 0 repositories
• SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation
  15 Aug 2021 · 0 repositories · arXiv:2108.06643
• How Optimal is Greedy Decoding for Extractive Question Answering?
  12 Aug 2021 · 1 repository · arXiv:2108.05857
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
• Exploring Listwise Evidence Reasoning with T5 for Fact Verification
  1 Aug 2021 · 0 repositories
• nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?
  1 Aug 2021 · 0 repositories
• YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective
  1 Aug 2021 · 1 repository
• EmailSum: Abstractive Email Thread Summarization
  30 Jul 2021 · 1 repository · arXiv:2107.14691
• Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills
  15 Jul 2021 · 1 repository · arXiv:2107.07261
• ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
  5 Jul 2021 · 2 repositories · arXiv:2107.02137
• Improving Factual Consistency of Abstractive Summarization on Customer Feedback
  30 Jun 2021 · 0 repositories · arXiv:2106.16188
• XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages
  25 Jun 2021 · 2 repositories · arXiv:2106.13822
  Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model
  24 Jun 2021 · 0 repositories · arXiv:2106.15332
• CPM-2: Large-scale Cost-effective Pre-trained Language Models
  20 Jun 2021 · 2 repositories · arXiv:2106.10715
• JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs
  19 Jun 2021 · 1 repository · arXiv:2106.10502
• Improving Paraphrase Detection with the Adversarial Paraphrasing Task
  14 Jun 2021 · 1 repository · arXiv:2106.07691
• Memory-efficient Transformers via Top-k Attention
  13 Jun 2021 · 2 repositories · arXiv:2106.06899
• FastSeq: Make Sequence Generation Faster
  8 Jun 2021 · 1 repository · arXiv:2106.04718
• TIMEDIAL: Temporal Commonsense Reasoning in Dialog
  8 Jun 2021 · 1 repository · arXiv:2106.04571
• nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?
  3 Jun 2021 · 0 repositories · arXiv:2106.02171
• Evidence-based Factual Error Correction
  2 Jun 2021 · 1 repository · arXiv:2106.01072
• Implicit Representations of Meaning in Neural Language Models
  1 Jun 2021 · 1 repository · arXiv:2106.00737
• ByT5: Towards a token-free future with pre-trained byte-to-byte models
  28 May 2021 · 5 repositories · arXiv:2105.13626
  Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
• SciFive: a text-to-text transformer model for biomedical literature
  28 May 2021 · 1 repository · arXiv:2106.03598
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Attention as Inference via Fenchel Duality
  21 May 2021 · 0 repositories
• Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing
  18 May 2021 · 0 repositories · arXiv:2105.08807
• Stage-wise Fine-tuning for Graph-to-Text Generation
  17 May 2021 · 1 repository · arXiv:2105.08021
• Which transformer architecture fits my data? A vocabulary bottleneck in self-attention
  9 May 2021 · 0 repositories · arXiv:2105.03928
• MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs
  18 Apr 2021 · 2 repositories · arXiv:2104.08692
• The Power of Scale for Parameter-Efficient Prompt Tuning
  18 Apr 2021 · 12 repositories · arXiv:2104.08691
  Syntology community repositories only · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)
• Decrypting Cryptic Crosswords: Semantically Complex Wordplay Puzzles as a Target for NLP
  17 Apr 2021 · 2 repositories · arXiv:2104.08620
• A Survey of Recent Abstract Summarization Techniques
  15 Apr 2021 · 0 repositories · arXiv:2105.00824
• ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning
  15 Apr 2021 · 1 repository · arXiv:2104.07644
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
• NT5?! Training T5 to Perform Numerical Reasoning
  15 Apr 2021 · 1 repository · arXiv:2104.07307
• NAREOR: The Narrative Reordering Problem
  14 Apr 2021 · 1 repository · arXiv:2104.06669
• KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding
  9 Apr 2021 · 0 repositories · arXiv:2104.08145
• CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing
  6 Apr 2021 · 1 repository · arXiv:2104.02443
• Russian Paraphrasers: Paraphrase with Transformers
  1 Apr 2021 · 2 repositories
• Automatic Graph Partitioning for Very Large-scale Deep Learning
  30 Mar 2021 · 0 repositories · arXiv:2103.16063
• GLM: General Language Model Pretraining with Autoregressive Blank Infilling
  18 Mar 2021 · 8 repositories · arXiv:2103.10360
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
  7 Mar 2021 · 1 repository · arXiv:2103.04350
• Multi-task transfer learning for finding actionable information from crisis-related messages on social media
  26 Feb 2021 · 0 repositories · arXiv:2102.13395
• PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domains
  24 Feb 2021 · 1 repository · arXiv:2102.12206
• Quiz-Style Question Generation for News Stories
  18 Feb 2021 · 2 repositories · arXiv:2102.09094
• Transformer-Based Models for Question Answering on COVID19
  16 Jan 2021 · 0 repositories · arXiv:2101.11432
• Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting
  2 Jan 2021 · 1 repository · arXiv:2101.00416
• Pre-training Text-to-Text Transformers to Write and Reason with Concepts
  1 Jan 2021 · 0 repositories
• EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
  31 Dec 2020 · 1 repository · arXiv:2101.00063
  Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Evidence-based Factual Error Correction
  31 Dec 2020 · 3 repositories · arXiv:2012.15788
• Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization
  21 Dec 2020 · 1 repository · arXiv:2012.11204
• How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering
  2 Dec 2020 · 1 repository · arXiv:2012.00955
• Flight of the PEGASUS? Comparing Transformers on Few-shot and Zero-shot Multi-document Abstractive Summarization
  1 Dec 2020 · 1 repository
• Label Representations in Modeling Classification as Text Generation
  1 Dec 2020 · 0 repositories
• Learning from Task Descriptions
  16 Nov 2020 · 1 repository · arXiv:2011.08115
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language
  7 Nov 2020 · 2 repositories · arXiv:2011.03836
• ABNIRML: Analyzing the Behavior of Neural IR Models
  2 Nov 2020 · 2 repositories · arXiv:2011.00696
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 1 pointer-only (licence)
• Towards Zero-Shot Conditional Summarization with Adaptive Multi-Task Fine-Tuning
  1 Nov 2020 · 1 repository
• Measuring Association Between Labels and Free-Text Rationales
  24 Oct 2020 · 1 repository · arXiv:2010.12762
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Unsupervised Paraphrasing with Pretrained Language Models
  24 Oct 2020 · 0 repositories · arXiv:2010.12885
• mT5: A massively multilingual pre-trained text-to-text transformer
  22 Oct 2020 · 8 repositories · arXiv:2010.11934
  Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)
• Scientific Claim Verification with VERT5ERINI
  22 Oct 2020 · 0 repositories · arXiv:2010.11930
• Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent
  19 Oct 2020 · 1 repository · arXiv:2010.09697
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
• Chatbot Interaction with Artificial Intelligence: Human Data Augmentation with T5 and Language Transformer Ensemble for Text Classification
  12 Oct 2020 · 0 repositories · arXiv:2010.05990
• TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling
  8 Oct 2020 · 1 repository · arXiv:2010.03802
• Converting the Point of View of Messages Spoken to Virtual Assistants
  6 Oct 2020 · 2 repositories · arXiv:2010.02600
• MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
  25 Sep 2020 · 1 repository · arXiv:2009.12005
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 3 pointer-only (licence)
• UCD-CS at W-NUT 2020 Shared Task-3: A Text to Text Approach for COVID-19 Event Extraction on Social Media
  21 Sep 2020 · 1 repository · arXiv:2009.10047
• Lite Training Strategies for Portuguese-English and English-Portuguese Translation
  20 Aug 2020 · 1 repository · arXiv:2008.08769
• PARADE: Passage Representation Aggregation for Document Reranking
  20 Aug 2020 · 1 repository · arXiv:2008.09093
  Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
• PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data
  20 Aug 2020 · 3 repositories · arXiv:2008.09144
• Investigating Pretrained Language Models for Graph-to-Text Generation
  16 Jul 2020 · 3 repositories · arXiv:2007.08426
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 2 pointer-only (licence)
• HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections
  12 Jul 2020 · 0 repositories · arXiv:2007.05891
• Normalizador Neural de Datas e Endereços
  27 Jun 2020 · 0 repositories · arXiv:2007.04300