knowledge editing

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

3 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 88 papers with code (175 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Cross-Lingual Knowledge Editing in Large Language Models
  16 Sep 2023 4 repositories listed
  With the recent advancements in large language models (LLMs), knowledge editing has been shown as a promising technique to adapt LLMs to new knowledge without retraining from scratch.
• Retrieval-augmented Multilingual Knowledge Editing
  20 Dec 2023 3 repositories listed
  Knowledge represented in Large Language Models (LLMs) is quite often incorrect and can also become obsolete over time.
• Neuron-Level Knowledge Attribution in Large Language Models
  19 Dec 2023 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Additionally, since most static methods typically only identify "value neurons" directly contributing to the final prediction, we propose a method for identifying "query neurons" which activate these "value neurons".
• Benchmarking and Rethinking Knowledge Editing for Large Language Models
  24 May 2025 2 repositories listed
  This study offers new insights into the limitations of current knowledge editing methods and highlights the potential of context-based reasoning as a more robust alternative.
• AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models
  3 Oct 2024 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 1 pointer-only (licence)
  To address this, we introduce AlphaEdit, a novel solution that projects perturbation onto the null space of the preserved knowledge before applying it to the parameters.
• In-Context Editing: Learning Knowledge from Self-Induced Distributions
  17 Jun 2024 2 repositories listed Syntology ran 5 of 8 samples · 3 unverified · 8 pointer-only (licence)
  In scenarios where language models must incorporate new information efficiently without extensive retraining, traditional fine-tuning methods are prone to overfitting, degraded generalization, and unnatural language…
• Knowledge Circuits in Pretrained Transformers
  28 May 2024 2 repositories listed
  To date, most studies have concentrated on isolated components within these models, such as the Multilayer Perceptrons and attention head.
• DeepEdit: Knowledge Editing as Decoding with Constraints
  19 Jan 2024 2 repositories listed
  How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs).
• A Comprehensive Study of Knowledge Editing for Large Language Models
  2 Jan 2024 2 repositories listed
  In this paper, we first define the knowledge editing problem and then provide a comprehensive review of cutting-edge approaches.
• Assessing Knowledge Editing in Language Models via Relation Perspective
  15 Nov 2023 2 repositories listed Syntology ran 12 of 16 samples · 4 unverified · 16 pointer-only (licence)
  Knowledge Editing (KE) for modifying factual knowledge in Large Language Models (LLMs) has been receiving increasing attention.
• EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models
  14 Aug 2023 2 repositories listed Syntology ran 4 of 6 samples · 2 unverified
  Large Language Models (LLMs) usually suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data.
• MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  24 May 2023 2 repositories listed
  The information stored in large language models (LLMs) falls out of date quickly, and retraining from scratch is often not an option.
• Can We Edit Factual Knowledge by In-Context Learning?
  22 May 2023 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Inspired by in-context learning (ICL), a new paradigm based on demonstration contexts without parameter updating, we explore whether ICL can edit factual knowledge.
• Editing Language Model-based Knowledge Graph Embeddings
  25 Jan 2023 2 repositories listed
  To address this issue, we propose a new task of editing language model-based KG embeddings in this paper.
• Model Merging for Knowledge Editing
  14 Jun 2025 1 repository listed
  Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves.
• PropMEND: Hypernetworks for Knowledge Propagation in LLMs
  10 Jun 2025 1 repository listed
  Knowledge editing techniques for large language models (LLMs) can inject knowledge that is later reproducible verbatim, but they fall short on propagating that knowledge: models cannot answer questions that require…
• Beyond Memorization: A Rigorous Evaluation Framework for Medical Knowledge Editing
  4 Jun 2025 1 repository listed
  Additionally, we offer deeper insights into medical knowledge editing, including the localization of medical knowledge in LLMs and the impact of sequential editing on evolving knowledge.
• Context Robust Knowledge Editing for Language Models
  29 May 2025 1 repository listed
  To mitigate this shortcoming, we introduce CoRE, a KE method designed to strengthen context robustness by minimizing context-sensitive variance in hidden states of the model for edited knowledge.
• ScEdit: Script-based Assessment of Knowledge Editing
  29 May 2025 1 repository listed
  Knowledge Editing (KE) has gained increasing attention, yet current KE tasks remain relatively simple.
• Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing
  19 May 2025 1 repository listed
  Furthermore, we extend our analysis to the task of superficial unlearning, where we observe consistent patterns in the behavior of specific attention heads and their corresponding left singular vectors, thereby…
• Can We Edit LLMs for Long-Tail Biomedical Knowledge?
  14 Apr 2025 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge.
• ADS-Edit: A Multimodal Knowledge Editing Dataset for Autonomous Driving Systems
  26 Mar 2025 1 repository listed
  To address these challenges, we propose the use of Knowledge Editing, which enables targeted modifications to a model's behavior without the need for full retraining.
• CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
  20 Mar 2025 1 repository listed Syntology ran 2 of 10 samples · 8 unverified
  Knowledge Editing (KE) enables the modification of outdated or incorrect information in large language models (LLMs).
• MindBridge: Scalable and Cross-Model Knowledge Editing via Memory-Augmented Modality
  4 Mar 2025 1 repository listed
  Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors.
• Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMs
  3 Mar 2025 1 repository listed Syntology ran 3 of 5 samples · 2 unverified
  Knowledge editing aims to update outdated information in Large Language Models (LLMs).
• MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
  27 Feb 2025 1 repository listed Syntology ran 8 of 12 samples · 4 unverified
  Knowledge editing techniques have emerged as essential tools for updating the factual knowledge of large language models (LLMs) and multimodal models (LMMs), allowing them to correct outdated or inaccurate information…
• FLEKE: Federated Locate-then-Edit Knowledge Editing
  21 Feb 2025 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  Locate-then-Edit Knowledge Editing (LEKE) is a key technique for updating large language models (LLMs) without full retraining.
• Revealing and Mitigating Over-Attention in Knowledge Editing
  20 Feb 2025 1 repository listed
  Large Language Models have demonstrated superior performance across a wide range of tasks, but they still exhibit undesirable errors due to incorrect knowledge learned from the training data.
• Related Knowledge Perturbation Matters: Rethinking Multiple Pieces of Knowledge Editing in Same-Subject
  8 Feb 2025 1 repository listed
  Knowledge editing has become a promising approach for efficiently and precisely updating knowledge embedded in large language models (LLMs).
• Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledge
  4 Feb 2025 1 repository listed
  Recent research has explored methods for updating and modifying factual knowledge in large language models, often focusing on specific multi-layer perceptron blocks.

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.