Method name prediction

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

15 shown of 15 papers with code (24 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Assessing Project-Level Fine-Tuning of ML4SE Models
  7 Jun 2022 2 repositories listed
  We evaluate three models of different complexity and compare their quality in three settings: trained on a large dataset of Java projects, further fine-tuned on the data from a particular project, and trained from…
• Syntax-Guided Program Reduction for Understanding Neural Code Intelligence Models
  28 May 2022 2 repositories listed
  Our experiments on multiple models across different types of input programs show that the syntax-guided program reduction technique is faster and provides smaller sets of key tokens in reduced programs.
• Extracting Label-specific Key Input Features for Neural Code Intelligence Models
  14 Feb 2022 2 repositories listed
  The code intelligence (CI) models are often black-box and do not offer any insights on the input features that they learn for making correct predictions.
• Memorization and Generalization in Neural Code Intelligence Models
  16 Jun 2021 2 repositories listed
  The goal of this paper is to evaluate and compare the extent of memorization and generalization in neural code intelligence models.
• Understanding Neural Code Intelligence Through Program Simplification
  7 Jun 2021 2 repositories listed
  Our approach, SIVAND, uses simplification techniques that reduce the size of input programs of a CI model while preserving the predictions of the model.
• Embedding Java Classes with code2vec: Improvements from Variable Obfuscation
  6 Apr 2020 2 repositories listed
  code2vec is a recently released embedding approach that uses the proxy task of method name prediction to map Java methods to feature vectors.
• Testing Neural Program Analyzers
  25 Aug 2019 2 repositories listed
  Deep neural networks have been increasingly used in software engineering and program analysis tasks.
• WRDScore: New Metric for Evaluation of Natural Language Generation Models
  29 May 2024 1 repository listed
  Recall is calculated as the total cost of the optimal transport plan that maps the reference sequence to the predicted one.
• Studying Vulnerable Code Entities in R
  6 Feb 2024 1 repository listed
  Pre-trained Code Language Models (Code-PLMs) have shown many advancements and achieved state-of-the-art results for many software engineering tasks in the past few years.
• TransformCode: A Contrastive Learning Framework for Code Embedding via Subtree Transformation
  10 Nov 2023 1 repository listed
  Our framework has several advantages over existing methods: (1) It is flexible and adaptable, because it can easily be extended to other downstream tasks that require code representation (such as code-clone detection…
• PSIMiner: A Tool for Mining Rich Abstract Syntax Trees from Code
  23 Mar 2021 1 repository listed
  PSI trees contain code syntax trees as well as functions to work with them, and therefore can be used to enrich code representation using static analysis algorithms of modern IDEs.
• Towards Demystifying Dimensions of Source Code Embeddings
  29 Aug 2020 1 repository listed
  A popular approach in representing source code is neural source code embeddings that represents programs with high-dimensional vectors computed by training deep neural networks on a large volume of programs.
• On the Generalizability of Neural Program Models with respect to Semantic-Preserving Program Transformations
  31 Jul 2020 1 repository listed
  With the prevalence of publicly available source code repositories to train deep neural network models, neural program models can do well in source code analysis tasks such as predicting method names in given programs…
• Contrastive Code Representation Learning
  9 Jul 2020 1 repository listed
  Recent work learns contextual representations of source code by reconstructing tokens from their context.
• Evaluation of Generalizability of Neural Program Analyzers under Semantic-Preserving Transformations
  15 Apr 2020 1 repository listed
  The abundance of publicly available source code repositories, in conjunction with the advances in neural networks, has enabled data-driven approaches to program analysis.