Methods › Natural Language Processing › Autoregressive Transformers › GPT-2 › Papers, page 5

GPT-2

Papers archive 2025-07-28

archive papers tagged: 768 · with a code link: 339 · where Syntology ran a sample: 125 (99 with a run with no instrument failure, 26 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (125 of 768 tagged: 99 with a run with no instrument failure, 26 where every run was a failure of Syntology's instrument)

Page 5 of 8: papers 401 to 500 of 768, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Semantic Coherence Markers for the Early Diagnosis of the Alzheimer Disease
  2 Feb 2023 · 1 repository · arXiv:2302.01025
• Analyzing Leakage of Personally Identifiable Information in Language Models
  1 Feb 2023 · 1 repository · arXiv:2302.00539
• The Exploration of Knowledge-Preserving Prompts for Document Summarisation
  27 Jan 2023 · 0 repositories · arXiv:2301.11719
• Audience-Centric Natural Language Generation via Style Infusion
  24 Jan 2023 · 1 repository · arXiv:2301.10283
• Automatic Generation of German Drama Texts Using Fine Tuned GPT-2 Models
  8 Jan 2023 · 0 repositories · arXiv:2301.03119
• Sequentially Controlled Text Generation
  5 Jan 2023 · 0 repositories · arXiv:2301.02299
• Targeted Phishing Campaigns using Large Scale Language Models
  30 Dec 2022 · 0 repositories · arXiv:2301.00665
• TegFormer: Topic-to-Essay Generation with Good Topic Coverage and High Text Coherence
  27 Dec 2022 · 0 repositories · arXiv:2212.13456
• Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?
  23 Dec 2022 · 0 repositories · arXiv:2212.12131
• Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal
  21 Dec 2022 · 1 repository · arXiv:2212.11185
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 8 pointer-only (licence)
• ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models
  20 Dec 2022 · 1 repository · arXiv:2212.10474
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• The case for 4-bit precision: k-bit Inference Scaling Laws
  19 Dec 2022 · 1 repository · arXiv:2212.09720
• MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation
  16 Dec 2022 · 0 repositories · arXiv:2212.08607
• Elixir: Train a Large Language Model on a Small GPU Cluster
  10 Dec 2022 · 2 repositories · arXiv:2212.05339
• The Turing Deception
  9 Dec 2022 · 0 repositories · arXiv:2212.06721
• TRBLLmaker -- Transformer Reads Between Lyrics Lines maker
  9 Dec 2022 · 0 repositories · arXiv:2212.04917
• Explain to me like I am five -- Sentence Simplification Using Transformers
  8 Dec 2022 · 1 repository · arXiv:2212.04595
• Modern French Poetry Generation with RoBERTa and GPT-2
  6 Dec 2022 · 0 repositories · arXiv:2212.02911
• Automatic Generation of Factual News Headlines in Finnish
  5 Dec 2022 · 0 repositories · arXiv:2212.02170
• Exploring the Limits of Differentially Private Deep Learning with Group-wise Clipping
  3 Dec 2022 · 0 repositories · arXiv:2212.01539
• Distilling Reasoning Capabilities into Smaller Language Models
  1 Dec 2022 · 1 repository · arXiv:2212.00193
• Quadapter: Adapter for GPT-2 Quantization
  30 Nov 2022 · 0 repositories · arXiv:2211.16912
• GPT-Neo for commonsense reasoning -- a theoretical and practical lens
  28 Nov 2022 · 1 repository · arXiv:2211.15593
• Scientific and Creative Analogies in Pretrained Language Models
  28 Nov 2022 · 2 repositories · arXiv:2211.15268
• Understanding BLOOM: An empirical study on diverse NLP tasks
  27 Nov 2022 · 0 repositories · arXiv:2211.14865
• Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task
  21 Nov 2022 · 2 repositories · arXiv:2211.11216
• A survey on knowledge-enhanced multimodal learning
  19 Nov 2022 · 0 repositories · arXiv:2211.12328
• TSMind: Alibaba and Soochow University's Submission to the WMT22 Translation Suggestion Task
  16 Nov 2022 · 0 repositories · arXiv:2211.08987
• Textual Data Augmentation for Patient Outcomes Prediction
  13 Nov 2022 · 0 repositories · arXiv:2211.06778
• Large Language Models Meet Harry Potter: A Bilingual Dataset for Aligning Dialogue Agents with Characters
  13 Nov 2022 · 1 repository · arXiv:2211.06869
• Collateral facilitation in humans and language models
  9 Nov 2022 · 1 repository · arXiv:2211.05198
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Active Example Selection for In-Context Learning
  8 Nov 2022 · 1 repository · arXiv:2211.04486
  Syntology official (archive's flag): 10 ran · 10 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples)
• Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
  1 Nov 2022 · 7 repositories · arXiv:2211.00593
  Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples)
• Text-Only Training for Image Captioning using Noise-Injected CLIP
  1 Nov 2022 · 4 repositories · arXiv:2211.00575
  Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
  31 Oct 2022 · 2 repositories · arXiv:2210.17432
• Probing for targeted syntactic knowledge through grammatical error detection
  28 Oct 2022 · 1 repository · arXiv:2210.16228
• Perfectly Secure Steganography Using Minimum Entropy Coupling
  24 Oct 2022 · 2 repositories · arXiv:2210.14889
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
• Team Flow at DRC2022: Pipeline System for Travel Destination Recommendation Task in Spoken Dialogue
  18 Oct 2022 · 0 repositories · arXiv:2210.09518
• A Generative User Simulator with GPT-based Architecture and Goal State Tracking for Reinforced Multi-Domain Dialog Systems
  17 Oct 2022 · 1 repository · arXiv:2210.08692
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)
• "John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility
  14 Oct 2022 · 1 repository · arXiv:2210.07471
• Jointly Reinforced User Simulator and Task-oriented Dialog System with Simplified Generative Architecture
  13 Oct 2022 · 0 repositories · arXiv:2210.06706
• Predictive Querying for Autoregressive Neural Sequence Models
  12 Oct 2022 · 1 repository · arXiv:2210.06464
  Syntology official (archive's flag): 7 ran · 7 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)
• SUMBot: Summarizing Context in Open-Domain Dialogue Systems
  12 Oct 2022 · 0 repositories · arXiv:2210.06496
• Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  9 Oct 2022 · 1 repository · arXiv:2210.04243
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models
  8 Oct 2022 · 0 repositories · arXiv:2210.03858
• SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  30 Sep 2022 · 1 repository · arXiv:2209.15323
• DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generation
  22 Sep 2022 · 0 repositories · arXiv:2209.10797
• Text Revealer: Private Text Reconstruction via Model Inversion Attacks against Transformers
  21 Sep 2022 · 0 repositories · arXiv:2209.10505
• Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech
  11 Sep 2022 · 0 repositories · arXiv:2209.04889
• Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbots
  7 Sep 2022 · 0 repositories · arXiv:2209.03463
• Every picture tells a story: Image-grounded controllable stylistic story generation
  4 Sep 2022 · 0 repositories · arXiv:2209.01638
• Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  13 Aug 2022 · 9 repositories · arXiv:2208.06677
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writing
  1 Aug 2022 · 0 repositories · arXiv:2208.00636
• Zero-Shot Video Captioning with Evolving Pseudo-Tokens
  22 Jul 2022 · 1 repository · arXiv:2207.11100
• Word Play for Playing Othello (Reverses)
  18 Jul 2022 · 0 repositories · arXiv:2207.08766
• Combing for Credentials: Active Pattern Extraction from Smart Reply
  14 Jul 2022 · 0 repositories · arXiv:2207.10802
• Hidden Schema Networks
  8 Jul 2022 · 0 repositories · arXiv:2207.03777
• Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps
  7 Jul 2022 · 0 repositories · arXiv:2207.03380
• Sensitivity Analysis on Transferred Neural Architectures of BERT and GPT-2 for Financial Sentiment Analysis
  7 Jul 2022 · 0 repositories · arXiv:2207.03037
• Materials Transformers Language Models for Generative Materials Design: a benchmark study
  27 Jun 2022 · 1 repository · arXiv:2206.13578
• Differentially Private Model Compression
  3 Jun 2022 · 0 repositories · arXiv:2206.01838
• Romantic-Computing
  1 Jun 2022 · 0 repositories · arXiv:2206.11864
• FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
  27 May 2022 · 13 repositories · arXiv:2205.14135
  Syntology official: no sample here; runs from other or unrecorded repositories · 24 ran (of which 2 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 1 violated, 17 with no contract checked; 6 where Syntology's instrument failed) · 6 unverified (of 30 harvested samples) · 1 pointer-only (licence)
• kNN-Prompt: Nearest Neighbor Zero-Shot Inference
  27 May 2022 · 1 repository · arXiv:2205.13792
• Garden-Path Traversal in GPT-2
  24 May 2022 · 1 repository · arXiv:2205.12302
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation
  19 May 2022 · 1 repository · arXiv:2205.09830
• Evaluation of Transfer Learning for Polish with a Text-to-Text Model
  18 May 2022 · 0 repositories · arXiv:2205.08808
• What GPT Knows About Who is Who
  16 May 2022 · 1 repository · arXiv:2205.07407
• Naturalistic Causal Probing for Morpho-Syntax
  14 May 2022 · 1 repository · arXiv:2205.07043
• Ratatouille: A tool for Novel Recipe Generation
  10 May 2022 · 0 repositories · arXiv:2206.08267
• Multi-segment preserving sampling for deep manifold sampler
  9 May 2022 · 0 repositories · arXiv:2205.04259
• When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it
  6 May 2022 · 1 repository · arXiv:2205.03472
• Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation
  28 Apr 2022 · 0 repositories · arXiv:2204.13362
• Zero-shot Entity and Tweet Characterization with Designed Conditional Prompts and Contexts
  18 Apr 2022 · 0 repositories · arXiv:2204.08405
• mGPT: Few-Shot Learners Go Multilingual
  15 Apr 2022 · 1 repository · arXiv:2204.07580
• Analysing similarities between legal court documents using natural language processing approaches based on Transformers
  14 Apr 2022 · 0 repositories · arXiv:2204.07182
• Uniform Complexity for Text Generation
  11 Apr 2022 · 1 repository · arXiv:2204.05185
• Accelerating Attention through Gradient-Based Learned Runtime Pruning
  7 Apr 2022 · 0 repositories · arXiv:2204.03227
• Testing the limits of natural language models for predicting human language judgments
  7 Apr 2022 · 1 repository · arXiv:2204.03592
• Knowledge Infused Decoding
  6 Apr 2022 · 1 repository · arXiv:2204.03084
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems
  1 Apr 2022 · 0 repositories · arXiv:2204.00212
• Monarch: Expressive Structured Matrices for Efficient and Accurate Training
  1 Apr 2022 · 2 repositories · arXiv:2204.00595
  Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 1 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples)
• A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots
  21 Mar 2022 · 1 repository · arXiv:2203.10759
• Compression of Generative Pre-trained Language Models via Quantization
  21 Mar 2022 · 0 repositories · arXiv:2203.10705
• Dependency-based Mixture Language Models
  19 Mar 2022 · 1 repository · arXiv:2203.10256
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
• Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators
  18 Mar 2022 · 0 repositories · arXiv:2203.09813
• Do Language Models Plagiarize?
  15 Mar 2022 · 1 repository · arXiv:2203.07618
• Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations
  14 Mar 2022 · 0 repositories · arXiv:2203.07511
• VAST: The Valence-Assessing Semantics Test for Contextualizing Language Models
  14 Mar 2022 · 1 repository · arXiv:2203.07504
• Block-Sparse Adversarial Attack to Fool Transformer-Based Text Classifiers
  11 Mar 2022 · 1 repository · arXiv:2203.05948
• When classifying grammatical role, BERT doesn't care about word order... except when it matters
  11 Mar 2022 · 1 repository · arXiv:2203.06204
• LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models
  4 Mar 2022 · 1 repository · arXiv:2203.02094
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)
• Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models
  2 Mar 2022 · 2 repositories · arXiv:2203.01104
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• A Systematic Evaluation of Large Language Models of Code
  26 Feb 2022 · 3 repositories · arXiv:2202.13169
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Defending against Reconstruction Attacks with Rényi Differential Privacy
  15 Feb 2022 · 0 repositories · arXiv:2202.07623
• Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam
  12 Feb 2022 · 1 repository · arXiv:2202.06009
• A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publications
  4 Feb 2022 · 1 repository · arXiv:2202.02013
• Pre-Trained Language Transformers are Universal Image Classifiers
  25 Jan 2022 · 0 repositories · arXiv:2201.10182
• Synthetic Books
  24 Jan 2022 · 0 repositories · arXiv:2201.09518
• Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation
  16 Jan 2022 · 0 repositories