Methods › Natural Language Processing › Autoregressive Transformers › GPT
GPT
Introduced by Alec Radford et al. in Improving Language Understanding by Generative Pre-Training
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
GPT is a Transformer-based architecture and training procedure for natural language processing tasks. Training follows a two-stage procedure. First, a language modeling objective is used on the unlabeled data to learn the initial parameters of a neural network model. Subsequently, these parameters are adapted to a target task using the corresponding supervised objective.
Source in the archive: Improving Language Understanding by Generative Pre-Training, a link on s3-us-west-2.amazonaws.com (archive link, not checked and not linked: not a paper host this site links to).
In Syntology no code under this exact name (no_code; paper_only). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2610.01022) is about this method is not checked; it does not say whether this method has code.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 1,212 · with a code link: 453 · where Syntology ran a sample: 152 (124 with a run with no instrument failure, 28 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (152 of 1,212 tagged: 124 with a run with no instrument failure, 28 where every run was a failure of Syntology's instrument)
Page 1 of 13: papers 1 to 100 of 1,212, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Making Language Model a Hierarchical Classifier and Generator 17 Jul 2025 · 1 repository · arXiv:2507.12930
-
Generative Click-through Rate Prediction with Applications to Search Advertising 15 Jul 2025 · 0 repositories · arXiv:2507.11246
-
Behaviour Space Analysis of LLM-driven Meta-heuristic Discovery 4 Jul 2025 · 0 repositories · arXiv:2507.03605
-
Agent-to-Agent Theory of Mind: Testing Interlocutor Awareness among Large Language Models 28 Jun 2025 · 0 repositories · arXiv:2506.22957
-
Cat and Mouse -- Can Fake Text Generation Outpace Detector Systems? 26 Jun 2025 · 0 repositories · arXiv:2506.21274
-
Large Language Models Acing Chartered Accountancy 26 Jun 2025 · 0 repositories · arXiv:2506.21031
-
Large Language Model-Driven Code Compliance Checking in Building Information Modeling 25 Jun 2025 · 0 repositories · arXiv:2506.20551
-
InsertRank: LLMs can reason over BM25 scores to Improve Listwise Reranking 17 Jun 2025 · 0 repositories · arXiv:2506.14086
-
Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks 17 Jun 2025 · 0 repositories · arXiv:2506.14098
-
NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI Tutors 12 Jun 2025 · 1 repository · arXiv:2506.10627
-
Latent Multi-Head Attention for Small Language Models 11 Jun 2025 · 0 repositories · arXiv:2506.09342
-
AraReasoner: Evaluating Reasoning-Based LLMs for Arabic NLP 10 Jun 2025 · 0 repositories · arXiv:2506.08768
-
Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving 10 Jun 2025 · 1 repository · arXiv:2506.08349Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Generative Voice Bursts during Phone Call 9 Jun 2025 · 0 repositories · arXiv:2506.07526
-
LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization 9 Jun 2025 · 0 repositories · arXiv:2506.07570
-
RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluation 7 Jun 2025 · 0 repositories · arXiv:2506.06677
-
Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Survey 6 Jun 2025 · 0 repositories · arXiv:2506.11102
-
The Lock-in Hypothesis: Stagnation by Algorithm 6 Jun 2025 · 0 repositories · arXiv:2506.06166
-
Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning 5 Jun 2025 · 1 repository · arXiv:2506.04998
-
Privacy and Security Threat for OpenAI GPTs 4 Jun 2025 · 0 repositories · arXiv:2506.04036
-
Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks 30 May 2025 · 1 repository · arXiv:2505.24876
-
MOFGPT: Generative Design of Metal-Organic Frameworks using Language Models 30 May 2025 · 1 repository · arXiv:2506.00198
-
When GPT Spills the Tea: Comprehensive Assessment of Knowledge File Leakage in GPTs 30 May 2025 · 0 repositories · arXiv:2506.00197
-
Daunce: Data Attribution through Uncertainty Estimation 29 May 2025 · 0 repositories · arXiv:2505.23223
-
Reducing Latency in LLM-Based Natural Language Commands Processing for Robot Navigation 29 May 2025 · 0 repositories · arXiv:2506.00075
-
Multi-MLLM Knowledge Distillation for Out-of-Context News Detection 28 May 2025 · 0 repositories · arXiv:2505.22517
-
Explainability of Large Language Models using SMILE: Statistical Model-agnostic Interpretability with Local Explanations 27 May 2025 · 1 repository · arXiv:2505.21657
-
From prosthetic memory to prosthetic denial: Auditing whether large language models are prone to mass atrocity denialism 27 May 2025 · 0 repositories · arXiv:2505.21753
-
Automated evaluation of children's speech fluency for low-resource languages 26 May 2025 · 0 repositories · arXiv:2505.19671
-
Beyond Specialization: Benchmarking LLMs for Transliteration of Indian Languages 26 May 2025 · 0 repositories · arXiv:2505.19851
-
AI4Math: A Native Spanish Benchmark for University-Level Mathematical Reasoning in Large Language Models 25 May 2025 · 0 repositories · arXiv:2505.18978
-
From Reddit to Generative AI: Evaluating Large Language Models for Anxiety Support Fine-tuned on Social Media Data 24 May 2025 · 0 repositories · arXiv:2505.18464
-
LLM assisted web application functional requirements generation: A case study of four popular LLMs over a Mess Management System 23 May 2025 · 0 repositories · arXiv:2505.18019
-
MMMG: a Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation 23 May 2025 · 0 repositories · arXiv:2505.17613
-
ShIOEnv: A CLI Behavior-Capturing Environment Enabling Grammar-Guided Command Synthesis for Dataset Curation 23 May 2025 · 1 repository · arXiv:2505.18374
-
Data-Driven Breakthroughs and Future Directions in AI Infrastructure: A Comprehensive Review 22 May 2025 · 0 repositories · arXiv:2505.16771
-
Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers 22 May 2025 · 0 repositories · arXiv:2505.16241
-
An Efficient Private GPT Never Autoregressively Decodes 21 May 2025 · 0 repositories · arXiv:2505.15252
-
Choosing a Model, Shaping a Future: Comparing LLM Perspectives on Sustainability and its Relationship with AI 20 May 2025 · 0 repositories · arXiv:2505.14435
-
EEG-to-Text Translation: A Model for Deciphering Human Brain Activity 20 May 2025 · 1 repository · arXiv:2505.13936
-
Every Pixel Tells a Story: End-to-End Urdu Newspaper OCR 20 May 2025 · 0 repositories · arXiv:2505.13943
-
Generative AI at the Crossroads: Light Bulb, Dynamo, or Microscope? 20 May 2025 · 0 repositories · arXiv:2505.14588
-
Video-GPT via Next Clip Diffusion 18 May 2025 · 1 repository · arXiv:2505.12489
-
Towards Cultural Bridge by Bahnaric-Vietnamese Translation Using Transfer Learning of Sequence-To-Sequence Pre-training Language Model 16 May 2025 · 0 repositories · arXiv:2505.11421
-
ACSE-Eval: Can LLMs threat model real-world cloud infrastructure? 16 May 2025 · 1 repository · arXiv:2505.11565
-
Atomic Consistency Preference Optimization for Long-Form Question Answering 14 May 2025 · 1 repository · arXiv:2505.09039
-
Multilingual Machine Translation with Quantum Encoder Decoder Attention-based Convolutional Variational Circuits 14 May 2025 · 0 repositories · arXiv:2505.09407
-
Evaluating LLM Metrics Through Real-World Capabilities 13 May 2025 · 0 repositories · arXiv:2505.08253
-
Small but Significant: On the Promise of Small Language Models for Accessible AIED 13 May 2025 · 0 repositories · arXiv:2505.08588
-
No Query, No Access 12 May 2025 · 0 repositories · arXiv:2505.07258
-
Evaluating Reasoning LLMs for Suicide Screening with the Columbia-Suicide Severity Rating Scale 11 May 2025 · 1 repository · arXiv:2505.13480
-
CellVerse: Do Large Language Models Really Understand Cell Biology? 9 May 2025 · 0 repositories · arXiv:2505.07865
-
Multi-Agent Systems for Robotic Autonomy with LLMs 9 May 2025 · 0 repositories · arXiv:2505.05762
-
AI Approaches to Qualitative and Quantitative News Analytics on NATO Unity 8 May 2025 · 0 repositories · arXiv:2505.06313
-
An Empirical Study of OpenAI API Discussions on Stack Overflow 7 May 2025 · 0 repositories · arXiv:2505.04084
-
Towards Effectively Leveraging Execution Traces for Program Repair with Code LLMs 7 May 2025 · 0 repositories · arXiv:2505.04441
-
A Comparative Analysis of Ethical and Safety Gaps in LLMs using Relative Danger Coefficient 6 May 2025 · 0 repositories · arXiv:2505.04654
-
Evaluation of LLMs on Long-tail Entity Linking in Historical Documents 6 May 2025 · 0 repositories · arXiv:2505.03473
-
Transformers for Learning on Noisy and Task-Level Manifolds: Approximation and Generalization Insights 6 May 2025 · 0 repositories · arXiv:2505.03205
-
Memorization or Interpolation ? Detecting LLM Memorization through Input Perturbation Analysis 5 May 2025 · 0 repositories · arXiv:2505.03019
-
A Domain Adaptation of Large Language Models for Classifying Mechanical Assembly Components 2 May 2025 · 0 repositories · arXiv:2505.01627
-
Adversarial Attacks on LLM-as-a-Judge Systems: Insights from Prompt Injections 25 Apr 2025 · 0 repositories · arXiv:2504.18333
-
Optimism, Expectation, or Sarcasm? Multi-Class Hope Speech Detection in Spanish and English 24 Apr 2025 · 0 repositories · arXiv:2504.17974
-
A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms 23 Apr 2025 · 0 repositories · arXiv:2504.16420
-
Benchmarking LLM for Code Smells Detection: OpenAI GPT-4.0 vs DeepSeek-V3 22 Apr 2025 · 0 repositories · arXiv:2504.16027
-
The 1st EReL@MIR Workshop on Efficient Representation Learning for Multimodal Information Retrieval 21 Apr 2025 · 0 repositories · arXiv:2504.14788
-
AI with Emotions: Exploring Emotional Expressions in Large Language Models 20 Apr 2025 · 0 repositories · arXiv:2504.14706
-
Less is More: Adaptive Coverage for Synthetic Training Data 20 Apr 2025 · 0 repositories · arXiv:2504.14508
-
ZeroSumEval: Scaling LLM Evaluation with Inter-Model Competition 17 Apr 2025 · 1 repository · arXiv:2504.12562
-
Using customized GPT to develop prompting proficiency in architectural AI-generated images 16 Apr 2025 · 0 repositories · arXiv:2504.13948
-
Hallucination-Aware Generative Pretrained Transformer for Cooperative Aerial Mobility Control 15 Apr 2025 · 0 repositories · arXiv:2504.10831
-
Paging Dr. GPT: Extracting Information from Clinical Notes to Enhance Patient Predictions 14 Apr 2025 · 0 repositories · arXiv:2504.12338
-
Examining GPT's Capability to Generate and Map Course Concepts and Their Relationship 11 Apr 2025 · 0 repositories · arXiv:2504.08856
-
SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling 11 Apr 2025 · 0 repositories · arXiv:2504.08719
-
AI Coding with Few-Shot Prompting for Thematic Analysis 10 Apr 2025 · 0 repositories · arXiv:2504.07408
-
Can Reasoning LLMs Enhance Clinical Document Classification? 10 Apr 2025 · 1 repository · arXiv:2504.08040
-
MRD-RAG: Enhancing Medical Diagnosis with Multi-Round Retrieval-Augmented Generation 10 Apr 2025 · 1 repository · arXiv:2504.07724
-
Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning 9 Apr 2025 · 0 repositories · arXiv:2504.07198
-
Assessing how hyperparameters impact Large Language Models' sarcasm detection performance 8 Apr 2025 · 0 repositories · arXiv:2504.06166
-
Do LLM Evaluators Prefer Themselves for a Reason? 4 Apr 2025 · 1 repository · arXiv:2504.03846
-
Metamorphic Testing for Fairness Evaluation in Large Language Models: Identifying Intersectional Bias in LLaMA and GPT 4 Apr 2025 · 0 repositories · arXiv:2504.07982
-
Efficient Model Selection for Time Series Forecasting via LLMs 2 Apr 2025 · 0 repositories · arXiv:2504.02119
-
GPT Adoption and the Impact of Disclosure Policies 2 Apr 2025 · 0 repositories · arXiv:2504.01566
-
A Unified Virtual Mixture-of-Experts Framework:Enhanced Inference and Hallucination Mitigation in Single-Model System 1 Apr 2025 · 0 repositories · arXiv:2504.03739
-
Grade Guard: A Smart System for Short Answer Automated Grading 1 Apr 2025 · 0 repositories · arXiv:2504.01253
-
Text Chunking for Document Classification for Urban System Management using Large Language Models 31 Mar 2025 · 1 repository · arXiv:2504.00274
-
Large Language Models Are Better Logical Fallacy Reasoners with Counterargument, Explanation, and Goal-Aware Prompt Formulation 30 Mar 2025 · 1 repository · arXiv:2503.23363
-
SCORE: Story Coherence and Retrieval Enhancement for AI Narratives 30 Mar 2025 · 0 repositories · arXiv:2503.23512
-
Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT's Capabilities in Generating Metamorphic Relations 28 Mar 2025 · 0 repositories · arXiv:2503.22141
-
An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analyses 27 Mar 2025 · 0 repositories · arXiv:2503.21393
-
Advancements in Natural Language Processing: Exploring Transformer-Based Architectures for Text Understanding 26 Mar 2025 · 0 repositories · arXiv:2503.20227
-
Patients Speak, AI Listens: LLM-based Analysis of Online Reviews Uncovers Key Drivers for Urgent Care Satisfaction 26 Mar 2025 · 0 repositories · arXiv:2503.20981
-
How to Capture and Study Conversations Between Research Participants and ChatGPT: GPT for Researchers (g4r.org) 24 Mar 2025 · 0 repositories · arXiv:2503.18303
-
REALM: A Dataset of Real-World LLM Use Cases 24 Mar 2025 · 0 repositories · arXiv:2503.18792
-
DocVideoQA: Towards Comprehensive Understanding of Document-Centric Videos through Question Answering 20 Mar 2025 · 0 repositories · arXiv:2503.15887
-
TROVE: A Challenge for Fine-Grained Text Provenance via Source Sentence Tracing and Relationship Classification 19 Mar 2025 · 0 repositories · arXiv:2503.15289
-
XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistants 18 Mar 2025 · 0 repositories · arXiv:2503.14281
-
Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs 17 Mar 2025 · 0 repositories · arXiv:2503.13149
-
Can Language Models Follow Multiple Turns of Entangled Instructions? 17 Mar 2025 · 1 repository · arXiv:2503.13222
-
Feature Extraction and Analysis for GPT-Generated Text 17 Mar 2025 · 0 repositories · arXiv:2503.13687
Tasks archive 2025-07-28
20 shown of 583 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections