Methods › Natural Language Processing › Autoregressive Transformers › GPT-2 › Papers, page 7
GPT-2
Papers archive 2025-07-28
archive papers tagged: 768 · with a code link: 339 · where Syntology ran a sample: 125 (99 with a run with no instrument failure, 26 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (125 of 768 tagged: 99 with a run with no instrument failure, 26 where every run was a failure of Syntology's instrument)
Page 7 of 8: papers 601 to 700 of 768, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Surface Form Competition: Why the Highest Probability Answer Isn't Always Right 16 Apr 2021 · 2 repositories · arXiv:2104.08315Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
NAREOR: The Narrative Reordering Problem 14 Apr 2021 · 1 repository · arXiv:2104.06669
-
Understanding Transformers for Bot Detection in Twitter 13 Apr 2021 · 1 repository · arXiv:2104.06182
-
Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State Tracking 9 Apr 2021 · 1 repository · arXiv:2104.04466
-
Using GPT-2 to Create Synthetic Data to Improve the Prediction Performance of NLP Machine Learning Classification Models 2 Apr 2021 · 0 repositories · arXiv:2104.10658
-
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 24 Mar 2021 · 0 repositories · arXiv:2103.13033
-
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation 19 Mar 2021 · 0 repositories · arXiv:2103.10918
-
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do 8 Mar 2021 · 1 repository · arXiv:2103.11790Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Disentangling Syntax and Semantics in the Brain with Deep Networks 2 Mar 2021 · 0 repositories · arXiv:2103.01620
-
Long Document Summarization in a Low Resource Setting using Pretrained Language Models 1 Mar 2021 · 0 repositories · arXiv:2103.00751
-
Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models 23 Feb 2021 · 0 repositories · arXiv:2102.11570
-
THEaiTRE 1.0: Interactive generation of theatre play scripts 17 Feb 2021 · 0 repositories · arXiv:2102.08892
-
The corruptive force of AI-generated advice 15 Feb 2021 · 0 repositories · arXiv:2102.07536
-
AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Models 9 Feb 2021 · 1 repository · arXiv:2102.05126
-
A Hybrid Task-Oriented Dialog System with Domain and Task Adaptive Pretraining 8 Feb 2021 · 0 repositories · arXiv:2102.04506
-
Generating Fake Cyber Threat Intelligence Using Transformer-Based Models 8 Feb 2021 · 0 repositories · arXiv:2102.04351
-
Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models 8 Feb 2021 · 1 repository · arXiv:2102.04130Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labeling 6 Feb 2021 · 0 repositories · arXiv:2102.03551
-
Neural Data-to-Text Generation with LM-based Text Augmentation 6 Feb 2021 · 0 repositories · arXiv:2102.03556
-
Synthesizing Monolingual Data for Neural Machine Translation 29 Jan 2021 · 0 repositories · arXiv:2101.12462
-
BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets 22 Jan 2021 · 0 repositories · arXiv:2101.09345
-
Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach 19 Jan 2021 · 1 repository · arXiv:2101.07714
-
Adding Recurrence to Pretrained Transformers 1 Jan 2021 · 0 repositories
-
KETG: A Knowledge Enhanced Text Generation Framework 1 Jan 2021 · 0 repositories
-
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models 1 Jan 2021 · 1 repository · arXiv:2101.00288
-
Prefix-Tuning: Optimizing Continuous Prompts for Generation 1 Jan 2021 · 13 repositories · arXiv:2101.00190Syntology community repositories only · 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Pretrain Knowledge-Aware Language Models 1 Jan 2021 · 0 repositories
-
Conditional Generation of Temporally-ordered Event Sequences 31 Dec 2020 · 0 repositories · arXiv:2012.15786
-
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation 31 Dec 2020 · 1 repository · arXiv:2012.15416Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
The Pile: An 800GB Dataset of Diverse Text for Language Modeling 31 Dec 2020 · 22 repositories · arXiv:2101.00027Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Robust Dialogue Utterance Rewriting as Sequence Tagging 29 Dec 2020 · 1 repository · arXiv:2012.14535
-
Uncertainty and Surprisal Jointly Deliver the Punchline: Exploiting Incongruity-Based Features for Humor Recognition 22 Dec 2020 · 0 repositories · arXiv:2012.12007
-
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language Generation Models 19 Dec 2020 · 0 repositories · arXiv:2101.03216
-
Query expansion with artificially generated texts 16 Dec 2020 · 0 repositories · arXiv:2012.08787
-
RecipeNLG: A Cooking Recipes Dataset for Semi-Structured Text Generation 15 Dec 2020 · 1 repository
-
Extracting Training Data from Large Language Models 14 Dec 2020 · 3 repositories · arXiv:2012.07805Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
As Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languages 10 Dec 2020 · 1 repository · arXiv:2012.05628
-
Towards Neural Programming Interfaces 10 Dec 2020 · 1 repository · arXiv:2012.05983
-
CX DB8: A queryable extractive summarizer and semantic search engine 7 Dec 2020 · 2 repositories · arXiv:2012.03942
-
UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2 7 Dec 2020 · 1 repository · arXiv:2012.03539
-
Enhanced Offensive Language Detection Through Data Augmentation 5 Dec 2020 · 0 repositories · arXiv:2012.02954
-
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering 2 Dec 2020 · 1 repository · arXiv:2012.00955
-
A Deep Generative Approach to Native Language Identification 1 Dec 2020 · 0 repositories
-
Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation 1 Dec 2020 · 0 repositories
-
Hitachi at SemEval-2020 Task 11: An Empirical Study of Pre-Trained Transformer Family for Propaganda Detection 1 Dec 2020 · 0 repositories
-
Hitachi at SemEval-2020 Task 7: Stacking at Scale with Heterogeneous Language Models for Humor Recognition 1 Dec 2020 · 0 repositories
-
Hitachi at SemEval-2020 Task 8: Simple but Effective Modality Ensemble for Meme Emotion Recognition 1 Dec 2020 · 0 repositories
-
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching 1 Dec 2020 · 1 repository
-
UI at SemEval-2020 Task 4: Commonsense Validation and Explanation by Exploiting Contradiction 1 Dec 2020 · 0 repositories
-
Generative Pre-training for Paraphrase Generation by Representing and Predicting Spans in Exemplars 29 Nov 2020 · 0 repositories · arXiv:2011.14344
-
DebateSum: A large-scale argument mining and summarization dataset 14 Nov 2020 · 3 repositories · arXiv:2011.07251Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adapting a Language Model for Controlled Affective Text Generation 8 Nov 2020 · 1 repository · arXiv:2011.04000Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation 6 Nov 2020 · 1 repository · arXiv:2011.03286
-
Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions 1 Nov 2020 · 1 repository
-
Topic-Preserving Synthetic News Generation: An Adversarial Deep Reinforcement Learning Approach 30 Oct 2020 · 0 repositories · arXiv:2010.16324
-
Unsupervised Paraphrasing with Pretrained Language Models 24 Oct 2020 · 0 repositories · arXiv:2010.12885
-
Topic Modeling with Contextualized Word Representation Clusters 23 Oct 2020 · 0 repositories · arXiv:2010.12626
-
Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering 19 Oct 2020 · 0 repositories · arXiv:2010.09598
-
Decoding Methods for Neural Narrative Generation 14 Oct 2020 · 2 repositories · arXiv:2010.07375
-
The workweek is the best time to start a family -- A Study of GPT-2 Based Claim Generation 13 Oct 2020 · 0 repositories · arXiv:2010.06185
-
Meta-Context Transformers for Domain-Specific Response Generation 12 Oct 2020 · 1 repository · arXiv:2010.05572
-
Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU 11 Oct 2020 · 1 repository · arXiv:2010.05330
-
Investigating African-American Vernacular English in Transformer-Based Text Generation 6 Oct 2020 · 1 repository · arXiv:2010.02510
-
GenAug: Data Augmentation for Finetuning Text Generators 5 Oct 2020 · 2 repositories · arXiv:2010.01794
-
Inquisitive Question Generation for High Level Text Comprehension 4 Oct 2020 · 1 repository · arXiv:2010.01657
-
Examining the rhetorical capacities of neural language models 1 Oct 2020 · 0 repositories · arXiv:2010.00153
-
The design and implementation of Language Learning Chatbot with XAI using Ontology and Transfer Learning 29 Sep 2020 · 0 repositories · arXiv:2009.13984
-
Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions 29 Sep 2020 · 1 repository · arXiv:2009.14259Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
On Data Augmentation for Extreme Multi-label Classification 22 Sep 2020 · 0 repositories · arXiv:2009.10778
-
Prior Art Search and Reranking for Generated Patent Text 19 Sep 2020 · 0 repositories · arXiv:2009.09132
-
Critical Thinking for Language Models 15 Sep 2020 · 1 repository · arXiv:2009.07185Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Dialogue Response Ranking Training with Large-Scale Human Feedback Data 15 Sep 2020 · 2 repositories · arXiv:2009.06978Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
The Radicalization Risks of GPT-3 and Advanced Neural Language Models 15 Sep 2020 · 0 repositories · arXiv:2009.06807
-
GeDi: Generative Discriminator Guided Sequence Generation 14 Sep 2020 · 3 repositories · arXiv:2009.06367Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Brain2Word: Decoding Brain Activity for Language Generation 10 Sep 2020 · 1 repository · arXiv:2009.04765
-
Modern Methods for Text Generation 10 Sep 2020 · 2 repositories · arXiv:2009.04968
-
Black Box to White Box: Discover Model Characteristics Based on Strategic Probing 7 Sep 2020 · 0 repositories · arXiv:2009.03136
-
Improving Language Generation with Sentence Coherence Objective 7 Sep 2020 · 1 repository · arXiv:2009.06358
-
Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading 2 Sep 2020 · 1 repository · arXiv:2009.01303
-
DAVE: Deriving Automatically Verilog from English 27 Aug 2020 · 0 repositories · arXiv:2009.01026
-
ETC-NLG: End-to-end Topic-Conditioned Natural Language Generation 25 Aug 2020 · 1 repository · arXiv:2008.10875
-
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study 17 Aug 2020 · 0 repositories · arXiv:2008.13533
-
Narrative Interpolation for Generating and Understanding Stories 17 Aug 2020 · 0 repositories · arXiv:2008.07466
-
Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size 16 Aug 2020 · 0 repositories · arXiv:2008.07027
-
Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems 14 Aug 2020 · 0 repositories · arXiv:2008.06239
-
Navigating Human Language Models with Synthetic Agents 10 Aug 2020 · 0 repositories · arXiv:2008.04162
-
Multi-node Bert-pretraining: Cost-efficient Approach 1 Aug 2020 · 0 repositories · arXiv:2008.00177
-
Trojaning Language Models for Fun and Profit 1 Aug 2020 · 1 repository · arXiv:2008.00312
-
TweepFake: about Detecting Deepfake Tweets 31 Jul 2020 · 1 repository · arXiv:2008.00036
-
Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining 29 Jul 2020 · 1 repository · arXiv:2007.14587
-
Generative Pretraining from Pixels 17 Jul 2020 · 4 repositories
-
Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASR 14 Jul 2020 · 0 repositories · arXiv:2007.06949
-
The Go Transformer: Natural Language Modeling for Game Play 7 Jul 2020 · 0 repositories · arXiv:2007.03500
-
You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion 5 Jul 2020 · 0 repositories · arXiv:2007.02220
-
LSTM and GPT-2 Synthetic Speech Transfer Learning for Speaker Recognition to Overcome Data Scarcity 1 Jul 2020 · 0 repositories · arXiv:2007.00659
-
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models 1 Jul 2020 · 1 repository
-
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation 1 Jul 2020 · 1 repository
-
Knowledge-Aware Language Model Pretraining 29 Jun 2020 · 0 repositories · arXiv:2007.00655
-
Progressive Generation of Long Text with Pretrained Language Models 28 Jun 2020 · 1 repository · arXiv:2006.15720Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Video-Grounded Dialogues with Pretrained Generation Language Models 27 Jun 2020 · 0 repositories · arXiv:2006.15319