Browse State-of-the-Art › Method name prediction
Method name prediction
15 papers with code · 1 benchmark · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| CodeSearchNet (1 row) | ContraCode | Contrastive Code Representation Learning | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 24 · with a code link: 15 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran: none of the 24 tagged papers has a Syntology run on record
Page 1 of 1: papers 1 to 24 of 24, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
7 Jun 2022 2 repositories listedWe evaluate three models of different complexity and compare their quality in three settings: trained on a large dataset of Java projects, further fine-tuned on the data from a particular project, and trained from…
-
28 May 2022 2 repositories listedOur experiments on multiple models across different types of input programs show that the syntax-guided program reduction technique is faster and provides smaller sets of key tokens in reduced programs.
-
14 Feb 2022 2 repositories listedThe code intelligence (CI) models are often black-box and do not offer any insights on the input features that they learn for making correct predictions.
-
16 Jun 2021 2 repositories listedThe goal of this paper is to evaluate and compare the extent of memorization and generalization in neural code intelligence models.
-
7 Jun 2021 2 repositories listedOur approach, SIVAND, uses simplification techniques that reduce the size of input programs of a CI model while preserving the predictions of the model.
-
6 Apr 2020 2 repositories listedcode2vec is a recently released embedding approach that uses the proxy task of method name prediction to map Java methods to feature vectors.
-
25 Aug 2019 2 repositories listedDeep neural networks have been increasingly used in software engineering and program analysis tasks.
-
29 May 2024 1 repository listedRecall is calculated as the total cost of the optimal transport plan that maps the reference sequence to the predicted one.
-
6 Feb 2024 1 repository listedPre-trained Code Language Models (Code-PLMs) have shown many advancements and achieved state-of-the-art results for many software engineering tasks in the past few years.
-
10 Nov 2023 1 repository listedOur framework has several advantages over existing methods: (1) It is flexible and adaptable, because it can easily be extended to other downstream tasks that require code representation (such as code-clone detection…
-
23 Mar 2021 1 repository listedPSI trees contain code syntax trees as well as functions to work with them, and therefore can be used to enrich code representation using static analysis algorithms of modern IDEs.
-
29 Aug 2020 1 repository listedA popular approach in representing source code is neural source code embeddings that represents programs with high-dimensional vectors computed by training deep neural networks on a large volume of programs.
-
31 Jul 2020 1 repository listedWith the prevalence of publicly available source code repositories to train deep neural network models, neural program models can do well in source code analysis tasks such as predicting method names in given programs…
-
9 Jul 2020 1 repository listedRecent work learns contextual representations of source code by reconstructing tokens from their context.
-
Evaluation of Generalizability of Neural Program Analyzers under Semantic-Preserving Transformations15 Apr 2020 1 repository listedThe abundance of publicly available source code repositories, in conjunction with the advances in neural networks, has enabled data-driven approaches to program analysis.
-
Do Current Language Models Support Code Intelligence for R Programming Language?10 Oct 2024 0 repositories listedRecent advancements in developing Pre-trained Language Models for Code (Code-PLMs) have urged many areas of Software Engineering (SE) and brought breakthrough results for many SE tasks.
-
An Empirical Study on Capability of Large Language Models in Understanding Code Semantics4 Jul 2024 0 repositories listedLarge Language Models for Code (code LLMs) have demonstrated remarkable performance across various software engineering (SE) tasks, increasing the application of code LLMs in software development.
-
Evaluating the Impact of Source Code Parsers on ML4SE Models17 Jun 2022 0 repositories listedAs researchers and practitioners apply Machine Learning to increasingly more software engineering problems, the approaches they use become more sophisticated.
-
Code2Snapshot: Using Code Snapshots for Learning Representations of Source Code1 Nov 2021 0 repositories listedWe evaluate several variations of this representation and compare its performance with state-of-the-art representations that utilize the rich syntactic and semantic features of input programs.
-
Universal Representation for Code4 Mar 2021 0 repositories listedLearning from source code usually requires a large amount of labeled data.
-
InferCode: Self-Supervised Learning of Code Representations by Predicting Subtrees13 Dec 2020 0 repositories listedBuilding deep learning models on source code has found many successful software engineering applications, such as code search, code comment generation, bug detection, code migration, and so on.
-
Self-Supervised Contrastive Learning for Code Retrieval and Summarization via Semantic-Preserving Transformations6 Sep 2020 0 repositories listedWe propose Corder, a self-supervised contrastive learning framework for source code model.
-
Learning Semantic Program Embeddings with Graph Interval Neural Network18 May 2020 0 repositories listedLearning distributed representations of source code has been a challenging task for machine learning models.
-
Learning Blended, Precise Semantic Program Embeddings3 Jul 2019 0 repositories listedLearning neural program embeddings is key to utilizing deep neural networks in program languages research --- precise and efficient program representations enable the application of deep models to a wide range of…
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections