Code Translation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

10 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 54 papers with code (100 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Unsupervised Translation of Programming Languages
  5 Jun 2020 9 repositories listed Syntology ran 1 of 8 samples · 7 unverified
  We train our model on source code from open source GitHub projects, and show that it can translate functions between C++, Java, and Python with high accuracy.
• CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
  9 Feb 2021 7 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  Benchmark datasets have a significant impact on accelerating research in programming language tasks.
• CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation
  2 Sep 2021 5 repositories listed Syntology ran 1 of 11 samples · 10 unverified
  We present CodeT5, a unified pre-trained encoder-decoder Transformer model that better leverages the code semantics conveyed from the developer-assigned identifiers.
• CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
  22 Sep 2020 3 repositories listed Syntology ran 1 of 15 samples · 14 unverified
  Evaluation metrics play a vital role in the growth of an area as it defines the standard of distinguishing between good and bad models.
• MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers
  16 May 2023 2 repositories listed
  Message Passing Interface (MPI) plays a crucial role in distributed memory parallelization across multiple nodes.
• NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation
  15 Feb 2023 2 repositories listed
  First, we describe a state-of-the-art translation model used to generate Bash Commands from the corresponding English text.
• Multi-lingual Evaluation of Code Generation Models
  26 Oct 2022 2 repositories listed Syntology ran 1 of 6 samples · 5 unverified
  Using these benchmarks, we are able to assess the performance of code generation models in a multi-lingual fashion, and discovered generalization ability of language models on out-of-domain languages, advantages of…
• NatGen: Generative pre-training by "Naturalizing" source code
  15 Jun 2022 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  Pre-trained Generative Language models (e.
• CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models
  31 May 2022 2 repositories listed
  Pre-trained programming language (PL) models (such as CodeT5, CodeBERT, GraphCodeBERT, etc.,) have the potential to automate software engineering tasks involving code understanding and code generation.
• The impact of lexical and grammatical processing on generating code from natural language
  28 Feb 2022 2 repositories listed
  Considering the seq2seq architecture of TranX for natural language to code translation, we identify four key components of importance: grammatical constraints, lexical preprocessing, input representations, and copy…
• Unified Pre-training for Program Understanding and Generation
  10 Mar 2021 2 repositories listed
  Experiments on code summarization in the English language, code generation, and code translation in seven programming languages show that PLBART outperforms or rivals state-of-the-art models.
• DOBF: A Deobfuscation Pre-Training Objective for Programming Languages
  15 Feb 2021 2 repositories listed
  Recent advances in self-supervised learning have dramatically improved the state of the art on a wide variety of tasks.
• Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalization
  29 Jun 2020 2 repositories listed Syntology ran 2 of 14 samples · 12 unverified
  Empirically, we show that composed fine-tuning improves over standard fine-tuning on two pseudocode-to-code translation datasets (3% and 6% relative).
• Mutual-Supervised Learning for Sequential-to-Parallel Code Translation
  11 Jun 2025 1 repository listed
  MSL consists of two models, a Translator and a Tester.
• TimeSeriesGym: A Scalable Benchmark for (Time Series) Machine Learning Engineering Agents
  19 May 2025 1 repository listed
  Second, we implement evaluation mechanisms for multiple research artifacts, including submission files, code, and models, using both precise numeric measures and more flexible LLM-based evaluation approaches.
• CRUST-Bench: A Comprehensive Benchmark for C-to-safe-Rust Transpilation
  21 Apr 2025 1 repository listed Syntology ran 0 of 2 samples · 2 unverified · 2 pointer-only (licence)
  We introduce CRUST-Bench, a dataset of 100 C repositories, each paired with manually-written interfaces in safe Rust as well as test cases that can be used to validate correctness of the transpilation.
• nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow
  7 Feb 2025 1 repository listed
  Natural Language to Visualization (NL2Vis) seeks to convert natural-language descriptions into visual representations of given tables, empowering users to derive insights from large-scale data.
• GREEN-CODE: Learning to Optimize Energy Efficiency in LLM-based Code Generation
  19 Jan 2025 1 repository listed
  Results show that our method reduces the energy consumption between 23-50 % on average for code generation tasks without significantly affecting accuracy.
• Fortran2CPP: Automating Fortran-to-C++ Translation using LLMs via Multi-Turn Dialogue and Dual-Agent Integration
  27 Dec 2024 1 repository listed
  Translating legacy Fortran code into C++ is a crucial step in modernizing high-performance computing (HPC) applications.
• Transducer Tuning: Efficient Model Adaptation for Software Tasks Using Code Property Graphs
  18 Dec 2024 1 repository listed
  We introduce \approach, a technique to adapt large models for downstream code tasks using Code Property Graphs (CPGs).
• InterTrans: Leveraging Transitive Intermediate Translations to Enhance LLM-based Code Translation
  1 Nov 2024 1 repository listed
  To achieve this goal, we introduce InterTrans, an LLM-based automated code translation approach that, in contrast to existing approaches, leverages intermediate translations across PLs to bridge the syntactic and…
• Leveraging Large Language Models for Code Translation and Software Development in Scientific Computing
  31 Oct 2024 1 repository listed
  The emergence of foundational models and generative artificial intelligence (GenAI) is poised to transform productivity in scientific computing, especially in code development, refactoring, and translating from one…
• AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation
  31 Oct 2024 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Several rule-based transpilers have been designed to automate code translation between different pairs of PLs.
• Rectifier: Code Translation with Corrector via LLMs
  10 Jul 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Software migration is garnering increasing attention with the evolution of software and society.
• Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  28 Jun 2024 1 repository listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  To address this problem, we propose Web2Code, a benchmark consisting of a new large-scale webpage-to-code dataset for instruction tuning and an evaluation framework for the webpage understanding and HTML code…
• Exploring and Unleashing the Power of Large Language Models in Automated Code Translation
  23 Apr 2024 1 repository listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  This paper investigates diverse LLMs and learning-based transpilers for automated code translation tasks, finding that: although certain LLMs have outperformed current transpilers, they still have some accuracy issues,…
• Exploring the Impact of the Output Format on the Evaluation of Large Language Models for Code Translation
  25 Mar 2024 1 repository listed
  Code translation between programming languages is a long-existing and critical task in software engineering, facilitating the modernization of legacy systems, ensuring cross-platform compatibility, and enhancing…
• Unlocking the Power of Large Language Models for Entity Alignment
  23 Feb 2024 1 repository listed Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
  To address the constraints of limited input KG data, ChatEA introduces a KG-code translation module that translates KG structures into a format understandable by LLMs, thereby allowing LLMs to utilize their extensive…
• EffiBench: Benchmarking the Efficiency of Automatically Generated Code
  3 Feb 2024 1 repository listed Syntology ran 3 of 5 samples · 2 unverified · 5 pointer-only (licence)
  This paper presents EffiBench, a benchmark with 1, 000 efficiency-critical coding problems to assess the efficiency of code generated by code generation models.
• INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair
  16 Nov 2023 1 repository listed
  INTERVENOR prompts Large Language Models (LLMs) to play distinct roles during the code repair process, functioning as both a Code Learner and a Code Teacher.

Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.