Methods › Natural Language Processing › Transformers › GPT-Neo
GPT-Neo
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
An implementation of model & data parallel GPT3-like models using the mesh-tensorflow library.
Source: EleutherAI/GPT-Neo
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: GPT; NEO; H-GPT; GPT-D; MS-GPT; RF-GPT; GPT-RE; GPT-ST.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 38 · with a code link: 24 · where Syntology ran a sample: 11 (9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (11 of 38 tagged: 9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 38 of 38, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
IRepair: An Intent-Aware Approach to Repair Data-Driven Errors in Large Language Models 10 Feb 2025 · 0 repositories · arXiv:2502.07072
-
Robust Hybrid Classical-Quantum Transfer Learning Model for Text Classification Using GPT-Neo 125M with LoRA & SMOTE Enhancement 12 Jan 2025 · 1 repository · arXiv:2501.10435
-
LLM Vocabulary Compression for Low-Compute Environments 10 Nov 2024 · 0 repositories · arXiv:2411.06371
-
BERTtime Stories: Investigating the Role of Synthetic Story Data in Language pre-training 20 Oct 2024 · 1 repository · arXiv:2410.15365
-
Reconstruction of Differentially Private Text Sanitization via Large Language Models 16 Oct 2024 · 0 repositories · arXiv:2410.12443
-
The Unreasonable Ineffectiveness of Nucleus Sampling on Mitigating Text Memorization 29 Aug 2024 · 1 repository · arXiv:2408.16345Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
WPN: An Unlearning Method Based on N-pair Contrastive Learning in Language Models 18 Aug 2024 · 0 repositories · arXiv:2408.09459
-
Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs 13 Aug 2024 · 1 repository · arXiv:2408.06621Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Semantic Membership Inference Attack against Large Language Models 14 Jun 2024 · 0 repositories · arXiv:2406.10218
-
Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's Showerthoughts 2 May 2024 · 1 repository · arXiv:2405.01660
-
More than Correlation: Do Large Language Models Learn Causal Representations of Space? 26 Dec 2023 · 0 repositories · arXiv:2312.16257
-
Fairness-Aware Structured Pruning in Transformers 24 Dec 2023 · 1 repository · arXiv:2312.15398Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
Scalable Extraction of Training Data from (Production) Language Models 28 Nov 2023 · 0 repositories · arXiv:2311.17035
-
Heaps' Law in GPT-Neo Large Language Model Emulated Corpora 10 Nov 2023 · 1 repository · arXiv:2311.06377
-
Watermarking LLMs with Weight Quantization 17 Oct 2023 · 1 repository · arXiv:2310.11237Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
TART: A plug-and-play Transformer module for task-agnostic reasoning 21 Sep 2023 · 1 repository
-
Fine-Tuning Large Language Models for Answering Programming Questions with Code Snippets 26 Jun 2023 · 0 repositories
-
Exposing Bias in Online Communities through Large-Scale Language Models 4 Jun 2023 · 0 repositories · arXiv:2306.02294
-
Test-Time Training on Nearest Neighbors for Large Language Models 29 May 2023 · 1 repository · arXiv:2305.18466Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning 19 May 2023 · 1 repository · arXiv:2305.11759
-
TinyStories: How Small Can Language Models Be and Still Speak Coherent English? 12 May 2023 · 8 repositories · arXiv:2305.07759Syntology 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 18 harvested samples)
-
Stealing the Decoding Algorithms of Language Models 8 Mar 2023 · 1 repository · arXiv:2303.04729
-
Bag of Tricks for Training Data Extraction from Language Models 9 Feb 2023 · 1 repository · arXiv:2302.04460Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times? 23 Dec 2022 · 0 repositories · arXiv:2212.12131
-
Explicit Knowledge Transfer for Weakly-Supervised Code Generation 30 Nov 2022 · 0 repositories · arXiv:2211.16740
-
GPT-Neo for commonsense reasoning -- a theoretical and practical lens 28 Nov 2022 · 1 repository · arXiv:2211.15593
-
Understanding BLOOM: An empirical study on diverse NLP tasks 27 Nov 2022 · 0 repositories · arXiv:2211.14865
-
Collateral facilitation in humans and language models 9 Nov 2022 · 1 repository · arXiv:2211.05198Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech 11 Sep 2022 · 0 repositories · arXiv:2209.04889
-
Materials Transformers Language Models for Generative Materials Design: a benchmark study 27 Jun 2022 · 1 repository · arXiv:2206.13578
-
Fault-Aware Neural Code Rankers 4 Jun 2022 · 1 repository · arXiv:2206.03865Syntology official (archive's flag): 4 ran · 4 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
What GPT Knows About Who is Who 16 May 2022 · 1 repository · arXiv:2205.07407
-
GPT-NeoX-20B: An Open-Source Autoregressive Language Model 14 Apr 2022 · 11 repositories · arXiv:2204.06745Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
A Systematic Evaluation of Large Language Models of Code 26 Feb 2022 · 3 repositories · arXiv:2202.13169Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Controlling Conditional Language Models without Catastrophic Forgetting 1 Dec 2021 · 2 repositories · arXiv:2112.00791Syntology official (archive's flag): 3 ran · 7 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 4 pointer-only (licence)
-
Jurassic is (almost) All You Need: Few-Shot Meaning-to-Text Generation for Open-Domain Dialogue 15 Oct 2021 · 0 repositories · arXiv:2110.08094
-
Teaching Autoregressive Language Models Complex Tasks By Demonstration 5 Sep 2021 · 1 repository · arXiv:2109.02102
-
Measuring Coding Challenge Competence With APPS 20 May 2021 · 3 repositories · arXiv:2105.09938Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 2 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 42 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections