Browse State-of-the-Art › Code Summarization
Code Summarization
82 papers with code · 0 benchmarks · 8 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
8 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 163 · with a code link: 82 · where Syntology ran a sample: 15 (14 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 163 tagged: 14 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 163, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
1 May 2020 9 repositories listedGenerating a readable summary that describes the functionality of a program is known as source code summarization.
-
9 Feb 2021 7 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Benchmark datasets have a significant impact on accelerating research in programming language tasks.
-
4 Apr 2019 7 repositories listedThe main use for these descriptions is in software documentation e. g. the one-sentence Java method descriptions in JavaDocs.
-
4 Aug 2018 6 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)The ability to generate natural language sequences from source code snippets has a variety of applications such as code summarization, documentation, and retrieval.
-
2 Sep 2021 5 repositories listed Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)We present CodeT5, a unified pre-trained encoder-decoder Transformer model that better leverages the code semantics conveyed from the developer-assigned identifiers.
-
13 May 2023 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)To address these limitations, we propose ``CodeT5+'', a family of encoder-decoder LLMs for code in which component modules can be flexibly combined to suit a wide range of downstream code tasks.
-
1 Dec 2021 2 repositories listedThe fusion between a graph representation like Abstract Syntax Tree (AST) and a source code sequence makes the use of current approaches computationally intractable for large input sequence lengths.
-
26 Aug 2021 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)To mimic developers' code or summary generation behavior, we propose a retrieval augmented framework, REDCODER, that retrieves relevant code or summaries from a retrieval database and provides them as a supplement to…
-
31 Mar 2021 2 repositories listedJupyter notebook allows data scientists to write machine learning code together with its documentation in cells.
-
10 Mar 2021 2 repositories listedExperiments on code summarization in the English language, code generation, and code translation in seven programming languages show that PLBART outperforms or rivals state-of-the-art models.
-
6 Apr 2020 2 repositories listedThe first approaches to use structural information flattened the AST into a sequence.
-
14 Oct 2019 2 repositories listed Syntology official (archive's flag): 3 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 4 pointer-only (licence)Code summarization (CS) and code generation (CG) are two crucial tasks in the field of automatic software development.
-
17 Nov 2018 2 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)To the best of our knowledge, most state-of-the-art approaches follow an encoder-decoder framework which encodes the code into a hidden space and then decode it into natural language space, suffering from two major…
-
14 May 2025 1 repository listedRecent advancements in source code summarization have leveraged transformer-based pre-trained models, including Large Language Models of Code (LLMCs), to automate and improve the generation of code summaries.
-
23 Feb 2025 1 repository listedThe study involved revising benchmarks for evaluating models at class and repository levels, assessing baseline models, and evaluating LLMs with in-context learning to determine the enhancement of summary quality with…
-
7 Jan 2025 1 repository listedPre-training a language model and then fine-tuning it has shown to be an efficient and effective technique for a wide range of code intelligence tasks, such as code generation, code summarization, and vulnerability…
-
18 Dec 2024 1 repository listedWe introduce \approach, a technique to adapt large models for downstream code tasks using Code Property Graphs (CPGs).
-
11 Nov 2024 1 repository listedDespite that, a comprehensive study that thoroughly compares and analyzes the performance of the state-of-the-art model editing techniques for adapting the knowledge within LLMs4Code across various code-related tasks is…
-
21 Oct 2024 1 repository listedSpecifically, it consists of a code structure aware retriever (CONAN-R) and a dual-view code representation-based retrieval-augmented generation model (CONAN-G).
-
5 Aug 2024 1 repository listedTo this end, we introduce XMainframe, a state-of-the-art large language model (LLM) specifically designed with knowledge of mainframe legacy systems and COBOL codebases.
-
9 Jul 2024 1 repository listedWe hope that our findings can provide a comprehensive understanding of code summarization in the era of LLMs.
-
8 Jul 2024 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 11 pointer-only (licence)Recent advancements in open-source code large language models (LLMs) have been driven by fine-tuning on the data generated from powerful closed-source LLMs, which are expensive to obtain.
-
23 May 2024 1 repository listedWe introduce AutoCoder, the first Large Language Model to surpass GPT-4 Turbo (April 2024) and GPT-4o in pass@1 on the Human Eval benchmark test (90.
-
10 Apr 2024 1 repository listedWe show that for the task of code summarization, the performance of these models on individual examples often depends on the amount of (subword) token overlap between the code and the corresponding reference natural…
-
7 Apr 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)When applying the Transformer architecture to source code, designing a good self-attention mechanism is critical as it affects how node relationship is extracted from the Abstract Syntax Trees (ASTs) of the source code.
-
16 Mar 2024 1 repository listedIn this work, we evaluate PEFT methods, LoRA, Compacter, and IA^3 on LLMs for code summarization and generation, with a particular emphasis on knowledge transfer to R as an unseen under-explored target language.
-
21 Feb 2024 1 repository listedNeural code summarization leverages deep learning models to automatically generate brief natural language summaries of code snippets.
-
6 Feb 2024 1 repository listedPre-trained Code Language Models (Code-PLMs) have shown many advancements and achieved state-of-the-art results for many software engineering tasks in the past few years.
-
26 Dec 2023 1 repository listedOur comprehensive experimental results show that PromptCS significantly outperforms instruction prompting schemes (including zero-shot learning and few-shot learning) on all four widely used metrics, and is comparable…
-
15 Dec 2023 1 repository listedBinary code summarization, while invaluable for understanding code semantics, is challenging due to its labor-intensive nature.
-
13 Dec 2023 1 repository listed
-
25 Oct 2023 1 repository listed
-
24 Oct 2023 1 repository listed
-
21 Oct 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples)
-
5 Sep 2023 1 repository listed
-
28 Aug 2023 1 repository listed
-
25 Aug 2023 1 repository listed
-
14 Aug 2023 1 repository listed
-
21 Jul 2023 1 repository listed
-
23 May 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples)
-
18 May 2023 1 repository listed
-
9 May 2023 1 repository listed
-
2 Apr 2023 1 repository listed
-
28 Mar 2023 1 repository listed
-
8 Feb 2023 1 repository listed
-
5 Feb 2023 1 repository listed
-
13 Dec 2022 1 repository listed
-
21 Nov 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
21 Sep 2022 1 repository listed
-
24 Jul 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples) · 2 pointer-only (licence)
-
15 Jun 2022 1 repository listed
-
13 Jun 2022 1 repository listed
-
23 May 2022 1 repository listed
-
10 May 2022 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
26 Apr 2022 1 repository listed
-
18 Mar 2022 1 repository listed
-
16 Mar 2022 1 repository listed
-
14 Feb 2022 1 repository listed
-
14 Feb 2022 1 repository listed
-
28 Jan 2022 1 repository listed
-
13 Jan 2022 1 repository listed
-
1 Dec 2021 1 repository listed
-
27 Nov 2021 1 repository listed
-
17 Nov 2021 1 repository listed
-
16 Nov 2021 1 repository listed
-
4 Nov 2021 1 repository listed
-
22 Aug 2021 1 repository listed
-
16 Aug 2021 1 repository listed
-
15 Jul 2021 1 repository listed
-
15 Jun 2021 1 repository listed
-
29 May 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
26 May 2021 1 repository listed
-
18 May 2021 1 repository listed
-
22 Mar 2021 1 repository listed
-
21 Mar 2021 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 6 samples that ran constructed an object rather than computing a result (of 8 harvested samples)
-
14 Mar 2021 1 repository listed
-
26 Feb 2021 1 repository listed
-
29 Dec 2020 1 repository listed
-
17 Sep 2020 1 repository listed
-
9 Jun 2020 1 repository listed
-
19 Jun 2019 1 repository listed
-
Rethinking the effects of data contamination in Code Intelligence3 Jun 2025 0 repositories listed
-
An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks27 May 2025 0 repositories listed
-
LEANCODE: Understanding Models Better for Code Simplification of Pre-trained Large Language Models20 May 2025 0 repositories listed
-
EVALOOP: Assessing LLM Robustness in Programming from a Self-consistency Perspective18 May 2025 0 repositories listed
-
Large Language Models are Qualified Benchmark Builders: Rebuilding Pre-Training Datasets for Advancing Code Intelligence Tasks28 Apr 2025 0 repositories listed
-
Code-Craft: Hierarchical Graph-Based Code Summarization for Enhanced Context Retrieval11 Apr 2025 0 repositories listed
-
Enhancing Code LLM Training with Programmer Attention19 Mar 2025 0 repositories listed
-
Commenting Higher-level Code Unit: Full Code, Reduced Code, or Hierarchical Code Summarization13 Mar 2025 0 repositories listed
-
Energy-Conscious LLM Decoding: Impact of Text Generation Strategies on GPU Energy Consumption17 Feb 2025 0 repositories listed
-
Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineering10 Feb 2025 0 repositories listed
-
Can Large Language Models Understand Intermediate Representations?7 Feb 2025 0 repositories listed
-
Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering Tasks6 Feb 2025 0 repositories listed
-
Analysis of Student-LLM Interaction in a Software Engineering Project3 Feb 2025 0 repositories listed
-
Hierarchical Repository-Level Code Summarization for Business Applications Using Local LLMs14 Jan 2025 0 repositories listed
-
Analysis on LLMs Performance for Code Summarization22 Dec 2024 0 repositories listed
-
On the Compression of Language Models for Code: An Empirical Study on CodeBERT18 Dec 2024 0 repositories listed
-
GeoCode-GPT: A Large Language Model for Geospatial Code Generation Tasks22 Oct 2024 0 repositories listed
-
ETF: An Entity Tracing Framework for Hallucination Detection in Code Summaries17 Oct 2024 0 repositories listed
Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections