{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/studying-large-language-model-behaviors-under","title":"Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documents","arxiv_id":"2404.16032","date":"2024-04-24","proceeding":null,"authors":["Evgenii Kortukov","Alexander Rubinstein","Elisa Nguyen","Seong Joon Oh"],"abstract":"Retrieval-augmented generation (RAG) mitigates many problems of fully parametric language models, such as temporal degradation, hallucinations, and lack of grounding. In RAG, the model's knowledge can be updated from documents provided in context. This leads to cases of conflict between the model's parametric knowledge and the contextual information, where the model may not always update its knowledge. Previous work studied context-memory knowledge conflicts by creating synthetic documents that contradict the model's correct parametric answers. We present a framework for studying such knowledge conflicts in a realistic setup. We update incorrect parametric knowledge using real conflicting documents. This reflects how knowledge conflicts arise in practice. In this realistic scenario, we find that knowledge updates fail less often than previously reported. In cases where the models still fail to update their answers, we find a parametric bias: the incorrect parametric answer appearing in context makes the knowledge update likelier to fail. These results suggest that the factual parametric knowledge of LLMs can negatively influence their reading abilities and behaviors. Our code is available at https://github.com/kortukov/realistic_knowledge_conflicts/ .","url_abs":"https://arxiv.org/abs/2404.16032v2","url_pdf":"https://arxiv.org/pdf/2404.16032v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"studying-large-language-model-behaviors-under","repo_url":"https://github.com/kortukov/realistic_knowledge_conflicts","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"},{"task_slug":"rag","task_name":"RAG"},{"task_slug":"retrieval-augmented-generation","task_name":"Retrieval-augmented Generation"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bart","method_name":"BART"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"rag","method_name":"RAG"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.16032","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.16032"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kortukov/realistic_knowledge_conflicts","reach":{"status":"ok"}}],"summary":{"ran":7,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"fc0c747bcbe5fd87","entry":"binomial_hypothesis_test","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/analysis.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fc0c747bcbe5fd87"}},{"code_sha256_prefix":"76a7c3a7422712b8","entry":"generate_one_token","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/model_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"76a7c3a7422712b8"}},{"code_sha256_prefix":"d46b4839f99ce1b8","entry":"load_csv_dataset","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/file_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/file_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d46b4839f99ce1b8"}},{"code_sha256_prefix":"26e1b8092bab58ce","entry":"load_json_dataset","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/file_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/file_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"26e1b8092bab58ce"}},{"code_sha256_prefix":"b70e091f78d4e3ac","entry":"load_model_and_tokenizer","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/model_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b70e091f78d4e3ac"}},{"code_sha256_prefix":"f17cc485606a10ea","entry":"load_parquet_dataset","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/file_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/file_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f17cc485606a10ea"}},{"code_sha256_prefix":"1747631e415c0e0d","entry":"remove_tags_from_ctx","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"0_download_data.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/0_download_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1747631e415c0e0d"}},{"code_sha256_prefix":"676e6dd24fe7e3b5","entry":"load_tokenizer","repo":"kortukov/realistic_knowledge_conflicts","repo_kind":"official","path":"src/model_utils.py","file_url":"https://github.com/kortukov/realistic_knowledge_conflicts/blob/HEAD/src/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"676e6dd24fe7e3b5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}