{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-chameleon-or-stubborn-sloth","title":"Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts","arxiv_id":"2305.13300","date":"2023-05-22","proceeding":null,"authors":["Jian Xie","Kai Zhang","Jiangjie Chen","Renze Lou","Yu Su"],"abstract":"By providing external information to large language models (LLMs), tool augmentation (including retrieval augmentation) has emerged as a promising solution for addressing the limitations of LLMs' static parametric memory. However, how receptive are LLMs to such external evidence, especially when the evidence conflicts with their parametric memory? We present the first comprehensive and controlled investigation into the behavior of LLMs when encountering knowledge conflicts. We propose a systematic framework to elicit high-quality parametric memory from LLMs and construct the corresponding counter-memory, which enables us to conduct a series of controlled experiments. Our investigation reveals seemingly contradicting behaviors of LLMs. On the one hand, different from prior wisdom, we find that LLMs can be highly receptive to external evidence even when that conflicts with their parametric memory, given that the external evidence is coherent and convincing. On the other hand, LLMs also demonstrate a strong confirmation bias when the external evidence contains some information that is consistent with their parametric memory, despite being presented with conflicting evidence at the same time. These results pose important implications that are worth careful consideration for the further development and deployment of tool- and retrieval-augmented LLMs. Resources are available at https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict.","url_abs":"https://arxiv.org/abs/2305.13300v4","url_pdf":"https://arxiv.org/pdf/2305.13300v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adaptive-chameleon-or-stubborn-sloth","repo_url":"https://github.com/osu-nlp-group/llm-knowledge-conflict","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"adaptive-chameleon-or-stubborn-sloth","repo_url":"https://github.com/copenlu/context-utilisation-for-rag","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2305.13300","atlas_url":"https://app.syntology.ai/?focus=2305.13300","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.13300"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/osu-nlp-group/llm-knowledge-conflict","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/copenlu/context-utilisation-for-rag","reach":null}],"summary":{"ran_draft_wrong":4,"ran":3,"unverified":3},"by_repo_kind":{"official":{"samples":7,"ran":6,"repositories":1},"listed":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"367590f6d8914402","entry":"build_claim_popQA","repo":"osu-nlp-group/llm-knowledge-conflict","repo_kind":"official","path":"code/prompt_preparation.py","file_url":"https://github.com/osu-nlp-group/llm-knowledge-conflict/blob/HEAD/code/prompt_preparation.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"367590f6d8914402"}},{"code_sha256_prefix":"db391e5200411c40","entry":"build_zeroshot_prompt_popQA_with_singleSource_evidence","repo":"osu-nlp-group/llm-knowledge-conflict","repo_kind":"official","path":"code/prompt_preparation.py","file_url":"https://github.com/osu-nlp-group/llm-knowledge-conflict/blob/HEAD/code/prompt_preparation.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"db391e5200411c40"}},{"code_sha256_prefix":"3589cdef8c72142f","entry":"calc_cost_w_tokens","repo":"OSU-NLP-Group/LLM-Knowledge-Conflict","repo_kind":"official","path":"code/openai_request.py","file_url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict/blob/HEAD/code/openai_request.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3589cdef8c72142f"}},{"code_sha256_prefix":"525dbdd48bc6f54c","entry":"get_prompt","repo":"copenlu/context-utilisation-for-rag","repo_kind":"listed","path":"src/get_model_predictions/get_model_predictions.py","file_url":"https://github.com/copenlu/context-utilisation-for-rag/blob/HEAD/src/get_model_predictions/get_model_predictions.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"525dbdd48bc6f54c"}},{"code_sha256_prefix":"f5009f2a6258e5e8","entry":"limited_execution_time","repo":"OSU-NLP-Group/LLM-Knowledge-Conflict","repo_kind":"official","path":"code/openai_request.py","file_url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict/blob/HEAD/code/openai_request.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f5009f2a6258e5e8"}},{"code_sha256_prefix":"959eef29433a0a23","entry":"load_line_json_data","repo":"OSU-NLP-Group/LLM-Knowledge-Conflict","repo_kind":"official","path":"code/prompt_preparation.py","file_url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict/blob/HEAD/code/prompt_preparation.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"959eef29433a0a23"}},{"code_sha256_prefix":"db2cf6f145458dbc","entry":"openai_unit_price","repo":"OSU-NLP-Group/LLM-Knowledge-Conflict","repo_kind":"official","path":"code/openai_request.py","file_url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict/blob/HEAD/code/openai_request.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"db2cf6f145458dbc"}},{"code_sha256_prefix":"56a4bdd3f8d69984","entry":"TextWithLogitsGenerationPipeline","repo":"copenlu/context-utilisation-for-rag","repo_kind":"listed","path":"src/get_model_predictions/get_model_predictions.py","file_url":"https://github.com/copenlu/context-utilisation-for-rag/blob/HEAD/src/get_model_predictions/get_model_predictions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"56a4bdd3f8d69984"}},{"code_sha256_prefix":"241d7275ea43ae59","entry":"build_zeroshot_prompt_popQA","repo":"OSU-NLP-Group/LLM-Knowledge-Conflict","repo_kind":"official","path":"code/prompt_preparation.py","file_url":"https://github.com/OSU-NLP-Group/LLM-Knowledge-Conflict/blob/HEAD/code/prompt_preparation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"241d7275ea43ae59"}},{"code_sha256_prefix":"56c7a4ff3e95f3a9","entry":"predict_veracity","repo":"copenlu/context-utilisation-for-rag","repo_kind":"listed","path":"src/get_model_predictions/get_model_predictions.py","file_url":"https://github.com/copenlu/context-utilisation-for-rag/blob/HEAD/src/get_model_predictions/get_model_predictions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"56c7a4ff3e95f3a9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}