{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/event-level-knowledge-editing","title":"Event-level Knowledge Editing","arxiv_id":"2402.13093","date":"2024-02-20","proceeding":null,"authors":["Hao Peng","Xiaozhi Wang","Chunyang Li","Kaisheng Zeng","Jiangshan Duo","Yixin Cao","Lei Hou","Juanzi Li"],"abstract":"Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world come from the occurrences of new events rather than direct changes in factual triplets. In this paper, we propose a new task setting: event-level knowledge editing, which directly edits new events into LLMs and improves over conventional triplet-level editing on (1) Efficiency. A single event edit leads to updates in multiple entailed knowledge triplets. (2) Completeness. Beyond updating factual knowledge, event-level editing also requires considering the event influences and updating LLMs' knowledge about future trends. We construct a high-quality event-level editing benchmark ELKEN, consisting of 1,515 event edits, 6,449 questions about factual knowledge, and 10,150 questions about future tendencies. We systematically evaluate the performance of various knowledge editing methods and LLMs on this benchmark. We find that ELKEN poses significant challenges to existing knowledge editing approaches. Our codes and dataset are publicly released to facilitate further research.","url_abs":"https://arxiv.org/abs/2402.13093v2","url_pdf":"https://arxiv.org/pdf/2402.13093v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"event-level-knowledge-editing","repo_url":"https://github.com/thu-keg/event-level-knowledge-editing","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":null,"task_name":"Triplet"},{"task_slug":"knowledge-editing","task_name":"knowledge editing"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.13093","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.13093"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/thu-keg/event-level-knowledge-editing","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":6,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"f683a2dbeec5a920","entry":"compute_fact","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"overall_event_level_metric.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/overall_event_level_metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f683a2dbeec5a920"}},{"code_sha256_prefix":"da8cb85a2c5ca2a6","entry":"parse_answer","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"overall_event_level_metric.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/overall_event_level_metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"da8cb85a2c5ca2a6"}},{"code_sha256_prefix":"d61f8bd8de819a5e","entry":"parse_local_answer","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"metric.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d61f8bd8de819a5e"}},{"code_sha256_prefix":"9e0abb69457fe1bc","entry":"parse_score","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"examiner/parse_result.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/examiner/parse_result.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"9e0abb69457fe1bc"}},{"code_sha256_prefix":"7da1f09a1752b039","entry":"parse_score","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"examiner/parse_result_locality.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/examiner/parse_result_locality.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7da1f09a1752b039"}},{"code_sha256_prefix":"f57f4532d74c1739","entry":"parse_tendency_answer","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"metric.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f57f4532d74c1739"}},{"code_sha256_prefix":"3ca6e16221a26022","entry":"get_model","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"serac/model.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/serac/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"3ca6e16221a26022"}},{"code_sha256_prefix":"78c3675976b18e58","entry":"query_openai_api_per_example","repo":"thu-keg/event-level-knowledge-editing","repo_kind":"official","path":"llm/openai-models.py","file_url":"https://github.com/thu-keg/event-level-knowledge-editing/blob/HEAD/llm/openai-models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"78c3675976b18e58"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}