Methods › Natural Language Processing › Transformers › GPT-3
GPT-3
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
GPT-3 is an autoregressive transformer model with 175 billion parameters. It uses the same architecture/model as GPT-2, including the modified initialization, pre-normalization, and reversible tokenization, with the exception that GPT-3 uses alternating dense and locally banded sparse attention patterns in the layers of the transformer, similar to the Sparse Transformer.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: GPT; GPT-D; H-GPT; RF-GPT; MS-GPT; GPT-RE; VA-GPT; GPT-ST.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 1,906 · with a code link: 866 · where Syntology ran a sample: 319 (248 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (319 of 1,906 tagged: 248 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 1 of 20: papers 1 to 100 of 1,906, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements 12 Jun 2025 · 0 repositories · arXiv:2506.10330
-
Think before You Simulate: Symbolic Reasoning to Orchestrate Neural Computation for Counterfactual Question Answering 12 Jun 2025 · 1 repository · arXiv:2506.10753
-
Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Models 9 Jun 2025 · 0 repositories · arXiv:2506.08147
-
Direct Behavior Optimization: Unlocking the Potential of Lightweight LLMs 6 Jun 2025 · 0 repositories · arXiv:2506.06401
-
Benchmarking Large Language Models on Homework Assessment in Circuit Analysis 5 Jun 2025 · 0 repositories · arXiv:2506.06390
-
Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights 5 Jun 2025 · 0 repositories · arXiv:2506.04851
-
Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliability 4 Jun 2025 · 0 repositories · arXiv:2506.03655
-
FinBERT2: A Specialized Bidirectional Encoder for Bridging the Gap in Finance-Specific Deployment of Large Language Models 31 May 2025 · 0 repositories · arXiv:2506.06335
-
Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training 29 May 2025 · 0 repositories · arXiv:2505.23971
-
Enhancing LLM-Based Code Generation with Complexity Metrics: A Feedback-Driven Approach 29 May 2025 · 0 repositories · arXiv:2505.23953
-
Say What You Mean: Natural Language Access Control with Large Language Models for Internet of Things 28 May 2025 · 0 repositories · arXiv:2505.23835
-
Conversational Lexicography: Querying Lexicographic Data on Knowledge Graphs with SPARQL through Natural Language 26 May 2025 · 0 repositories · arXiv:2505.19971
-
Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis 22 May 2025 · 1 repository · arXiv:2505.17241
-
Adversarial Testing in LLMs: Insights into Decision-Making Vulnerabilities 19 May 2025 · 0 repositories · arXiv:2505.13195
-
Are Large Language Models Good at Detecting Propaganda? 19 May 2025 · 0 repositories · arXiv:2505.13706
-
EVALOOP: Assessing LLM Robustness in Programming from a Self-consistency Perspective 18 May 2025 · 0 repositories · arXiv:2505.12185
-
Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents 16 May 2025 · 0 repositories · arXiv:2505.10961
-
Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data 15 May 2025 · 1 repository · arXiv:2505.10260
-
Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLM 13 May 2025 · 1 repository · arXiv:2505.08492
-
Evaluating the Effectiveness of Black-Box Prompt Optimization as the Scale of LLMs Continues to Grow 13 May 2025 · 0 repositories · arXiv:2505.08303
-
HealthBench: Evaluating Large Language Models Towards Improved Human Health 13 May 2025 · 1 repository · arXiv:2505.08775Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
GRADA: Graph-based Reranker against Adversarial Documents Attack 12 May 2025 · 1 repository · arXiv:2505.07546
-
REFINE-AF: A Task-Agnostic Framework to Align Language Models via Self-Generated Instructions using Reinforcement Learning from Automated Feedback 10 May 2025 · 0 repositories · arXiv:2505.06548
-
An empathic GPT-based chatbot to talk about mental disorders with Spanish teenagers 9 May 2025 · 0 repositories · arXiv:2505.05828
-
What Is Next for LLMs? Next-Generation AI Computing Hardware Using Photonic Chips 9 May 2025 · 0 repositories · arXiv:2505.05794
-
Performance Evaluation of Large Language Models in Bangla Consumer Health Query Summarization 8 May 2025 · 0 repositories · arXiv:2505.05070
-
Bringing legal knowledge to the public by constructing a legal question bank using large-scale pre-trained language model 7 May 2025 · 0 repositories · arXiv:2505.04132
-
A Domain Adaptation of Large Language Models for Classifying Mechanical Assembly Components 2 May 2025 · 0 repositories · arXiv:2505.01627
-
JaccDiv: A Metric and Benchmark for Quantifying Diversity of Generated Marketing Text in the Music Industry 29 Apr 2025 · 0 repositories · arXiv:2504.20849
-
VeriDebug: A Unified LLM for Verilog Debugging via Contrastive Embedding and Guided Correction 27 Apr 2025 · 0 repositories · arXiv:2504.19099
-
Why you shouldn't fully trust ChatGPT: A synthesis of this AI tool's error rates across disciplines and the software engineering lifecycle 26 Apr 2025 · 0 repositories · arXiv:2504.18858
-
Amplified Vulnerabilities: Structured Jailbreak Attacks on LLM-based Multi-Agent Debate 23 Apr 2025 · 0 repositories · arXiv:2504.16489
-
LLM Sensitivity Evaluation Framework for Clinical Diagnosis 18 Apr 2025 · 0 repositories · arXiv:2504.13475
-
Validating LLM-Generated Relevance Labels for Educational Resource Search 17 Apr 2025 · 0 repositories · arXiv:2504.12732
-
VEXP: A Low-Cost RISC-V ISA Extension for Accelerated Softmax Computation in Transformers 15 Apr 2025 · 0 repositories · arXiv:2504.11227
-
Lumos: Efficient Performance Modeling and Estimation for Large-scale LLM Training 12 Apr 2025 · 0 repositories · arXiv:2504.09307
-
Learning from Elders: Making an LLM-powered Chatbot for Retirement Communities more Accessible through User-centered Design 11 Apr 2025 · 0 repositories · arXiv:2504.08985
-
LLM for Comparative Narrative Analysis 11 Apr 2025 · 0 repositories · arXiv:2504.08211
-
PoGO: A Scalable Proof of Useful Work via Quantized Gradient Descent and Merkle Proofs 10 Apr 2025 · 0 repositories · arXiv:2504.07540
-
Weak-for-Strong: Training Weak Meta-Agent to Harness Strong Executors 7 Apr 2025 · 1 repository · arXiv:2504.04785
-
Efficient Dynamic Clustering-Based Document Compression for Retrieval-Augmented-Generation 4 Apr 2025 · 1 repository · arXiv:2504.03165
-
Task as Context Prompting for Accurate Medical Symptom Coding Using Large Language Models 3 Apr 2025 · 1 repository · arXiv:2504.03051
-
OnRL-RAG: Real-Time Personalized Mental Health Dialogue System 2 Apr 2025 · 0 repositories · arXiv:2504.02894
-
Strategize Globally, Adapt Locally: A Multi-Turn Red Teaming Agent with Dual-Level Learning 2 Apr 2025 · 0 repositories · arXiv:2504.01278
-
Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts? 31 Mar 2025 · 0 repositories · arXiv:2504.00163
-
Rubric Is All You Need: Enhancing LLM-based Code Evaluation With Question-Specific Rubrics 31 Mar 2025 · 0 repositories · arXiv:2503.23989
-
Beyond Detection: Designing AI-Resilient Assessments with Automated Feedback Tool to Foster Critical Thinking 30 Mar 2025 · 0 repositories · arXiv:2503.23622
-
LaViC: Adapting Large Vision-Language Models to Visually-Aware Conversational Recommendation 30 Mar 2025 · 1 repository · arXiv:2503.23312
-
A Training-free LLM Framework with Interaction between Contextually Related Subtasks in Solving Complex Tasks 29 Mar 2025 · 0 repositories · arXiv:2503.23053
-
Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT's Capabilities in Generating Metamorphic Relations 28 Mar 2025 · 0 repositories · arXiv:2503.22141
-
Leveraging LLMs for Predicting Unknown Diagnoses from Clinical Notes 28 Mar 2025 · 0 repositories · arXiv:2503.22092
-
An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analyses 27 Mar 2025 · 0 repositories · arXiv:2503.21393
-
Can We Make Code Green? Understanding Trade-Offs in LLMs vs. Human Code Optimizations 26 Mar 2025 · 0 repositories · arXiv:2503.20126
-
Iterative Prompting with Persuasion Skills in Jailbreaking Large Language Models 26 Mar 2025 · 0 repositories · arXiv:2503.20320
-
Investigating Recent Large Language Models for Vietnamese Machine Reading Comprehension 23 Mar 2025 · 0 repositories · arXiv:2503.18062
-
Unify and Triumph: Polyglot, Diverse, and Self-Consistent Generation of Unit Tests with LLMs 20 Mar 2025 · 0 repositories · arXiv:2503.16144
-
BurTorch: Revisiting Training from First Principles by Coupling Autodiff, Math Optimization, and Systems 18 Mar 2025 · 1 repository · arXiv:2503.13795
-
Integrating Chain-of-Thought and Retrieval Augmented Generation Enhances Rare Disease Diagnosis from Clinical Notes 15 Mar 2025 · 0 repositories · arXiv:2503.12286
-
Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models 13 Mar 2025 · 0 repositories · arXiv:2503.10617
-
It is Too Many Options: Pitfalls of Multiple-Choice Questions in Generative AI and Medical Education 13 Mar 2025 · 0 repositories · arXiv:2503.13508
-
Tempest: Autonomous Multi-Turn Jailbreaking of Large Language Models with Tree Search 13 Mar 2025 · 0 repositories · arXiv:2503.10619
-
VaxGuard: A Multi-Generator, Multi-Type, and Multi-Role Dataset for Detecting LLM-Generated Vaccine Misinformation 12 Mar 2025 · 0 repositories · arXiv:2503.09103
-
Context-aware Biases for Length Extrapolation 11 Mar 2025 · 1 repository · arXiv:2503.08067Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Llms, Virtual Users, and Bias: Predicting Any Survey Question Without Human Data 11 Mar 2025 · 0 repositories · arXiv:2503.16498
-
Exploring Multimodal Perception in Large Language Models Through Perceptual Strength Ratings 10 Mar 2025 · 0 repositories · arXiv:2503.06980
-
Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models 10 Mar 2025 · 0 repositories · arXiv:2503.07693
-
Effectiveness of Zero-shot-CoT in Japanese Prompts 9 Mar 2025 · 0 repositories · arXiv:2503.06765
-
Simulating and Analysing Human Survey Responses with Large Language Models: A Case Study in Energy Stated Preference 7 Mar 2025 · 0 repositories · arXiv:2503.10652
-
HILGEN: Hierarchically-Informed Data Generation for Biomedical NER Using Knowledgebases and Large Language Models 6 Mar 2025 · 0 repositories · arXiv:2503.04930
-
Use Me Wisely: AI-Driven Assessment for LLM Prompting Skills Development 4 Mar 2025 · 0 repositories · arXiv:2503.02532
-
Psychological Counseling Ability of Large Language Models 1 Mar 2025 · 0 repositories · arXiv:2503.07627
-
NutriGen: Personalized Meal Plan Generator Leveraging Large Language Models to Enhance Dietary and Nutritional Adherence 28 Feb 2025 · 1 repository · arXiv:2502.20601
-
Cognitive networks highlight differences and similarities in the STEM mindsets of human and LLM-simulated trainees, experts and academics 26 Feb 2025 · 0 repositories · arXiv:2502.19529
-
Assessing Large Language Models in Agentic Multilingual National Bias 25 Feb 2025 · 0 repositories · arXiv:2502.17945
-
Reasoning about Affordances: Causal and Compositional Reasoning in LLMs 23 Feb 2025 · 0 repositories · arXiv:2502.16606
-
Single-pass Detection of Jailbreaking Input in Large Language Models 21 Feb 2025 · 0 repositories · arXiv:2502.15435
-
RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering 19 Feb 2025 · 0 repositories · arXiv:2502.13361
-
An LLM-Powered Agent for Physiological Data Analysis: A Case Study on PPG-based Heart Rate Estimation 18 Feb 2025 · 0 repositories · arXiv:2502.12836
-
SmartLLM: Smart Contract Auditing using Custom Generative AI 17 Feb 2025 · 0 repositories · arXiv:2502.13167
-
Performance Review on LLM for solving leetcode problems 16 Feb 2025 · 0 repositories · arXiv:2502.15770
-
Vendi-RAG: Adaptively Trading-Off Diversity And Quality Significantly Improves Retrieval Augmented Generation With LLMs 16 Feb 2025 · 0 repositories · arXiv:2502.11228
-
Do Large Language Models Reason Causally Like Us? Even Better? 14 Feb 2025 · 0 repositories · arXiv:2502.10215
-
Grammar Control in Dialogue Response Generation for Language Learning Chatbots 11 Feb 2025 · 1 repository · arXiv:2502.07544
-
Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models 9 Feb 2025 · 0 repositories · arXiv:2502.06039
-
Large Language Models for In-File Vulnerability Localization Can Be "Lost in the End" 9 Feb 2025 · 0 repositories · arXiv:2502.06898
-
Forbidden Science: Dual-Use AI Challenge Benchmark and Scientific Refusal Tests 8 Feb 2025 · 0 repositories · arXiv:2502.06867
-
Can Large Language Models Understand Intermediate Representations? 7 Feb 2025 · 0 repositories · arXiv:2502.06854
-
PsyPlay: Personality-Infused Role-Playing Conversational Agents 6 Feb 2025 · 0 repositories · arXiv:2502.03821
-
CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance 4 Feb 2025 · 1 repository · arXiv:2502.04350
-
CoddLLM: Empowering Large Language Models for Data Analytics 1 Feb 2025 · 0 repositories · arXiv:2502.00329
-
KBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search 31 Jan 2025 · 1 repository · arXiv:2501.18922Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 8 harvested samples)
-
Large Language Models' Accuracy in Emulating Human Experts' Evaluation of Public Sentiments about Heated Tobacco Products on Social Media 31 Jan 2025 · 0 repositories · arXiv:2502.01658
-
General Embedding vs. Task-Specific Embedding: A Comparative Approach to Enhancing NLP Performance 30 Jan 2025 · 0 repositories
-
Unraveling the Capabilities of Language Models in News Summarization 30 Jan 2025 · 1 repository · arXiv:2501.18128
-
Hybrid Graphs for Table-and-Text based Question Answering using LLMs 29 Jan 2025 · 0 repositories · arXiv:2501.17767
-
Graph of Attacks with Pruning: Optimizing Stealthy Jailbreak Prompt Generation for Enhanced LLM Content Moderation 28 Jan 2025 · 1 repository · arXiv:2501.18638
-
An AI-Driven Live Systematic Reviews in the Brain-Heart Interconnectome: Minimizing Research Waste and Advancing Evidence Synthesis 25 Jan 2025 · 1 repository · arXiv:2501.17181
-
Speech Translation Refinement using Large Language Models 25 Jan 2025 · 1 repository · arXiv:2501.15090
-
Prompt-Based Cost-Effective Evaluation and Operation of ChatGPT as a Computer Programming Teaching Assistant 24 Jan 2025 · 0 repositories · arXiv:2501.17176
-
Rethinking Table Instruction Tuning 24 Jan 2025 · 1 repository · arXiv:2501.14693
Tasks archive 2025-07-28
20 shown of 665 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections