{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-09028","title":"OpenDecoder: Open Large Language Model Decoding to Incorporate Document Quality in RAG","arxiv_id":"2601.09028","date":"2026-01-13","proceeding":null,"authors":["Fengran Mo","Zhan Su","Yuchen Hui","Jinghan Zhang","Jia Ao Sun","Zheyuan Liu","Chao Zhang","Tetsuya Sakai","Jian-Yun Nie"],"abstract":"The development of large language models (LLMs) has achieved superior performance in a range of downstream tasks, including LLM-based retrieval-augmented generation (RAG). The quality of generated content heavily relies on the usefulness of the retrieved information and the capacity of LLMs' internal information processing mechanism to incorporate it in answer generation. It is generally assumed that the retrieved information is relevant to the question. However, the retrieved information may have a variable degree of relevance and usefulness, depending on the question and the document collection. It is important to take into account the relevance of the retrieved information in answer generation. In this paper, we propose OpenDecoder, a new approach that leverages explicit evaluation of the retrieved information as quality indicator features for generation. We aim to build a RAG model that is more robust to varying levels of noisy context. Three types of explicit evaluation information are considered: relevance score, ranking score, and QPP (query performance prediction) score. The experimental results on five benchmark datasets demonstrate the effectiveness and better robustness of OpenDecoder by outperforming various baseline methods. Importantly, this paradigm is flexible to be integrated with the post-training of LLMs for any purposes and incorporated with any type of external indicators.","url_abs":"https://arxiv.org/abs/2601.09028","url_pdf":"https://arxiv.org/pdf/2601.09028","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2601.09028","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.09028"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/fengranMark/OpenDecoder","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"unverified":13},"by_repo_kind":{"found_in_text":{"samples":14,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"58745a56a67a45ad","entry":"padding_seq_to_same_length","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/retrieval_dataset.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/retrieval_dataset.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"58745a56a67a45ad"}},{"code_sha256_prefix":"baa96c8fcc9b7403","entry":"acc_score","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/evaluation.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"baa96c8fcc9b7403"}},{"code_sha256_prefix":"9ba9e62b273b7c2b","entry":"calculate_similarity","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/construct_indicators.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/construct_indicators.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9ba9e62b273b7c2b"}},{"code_sha256_prefix":"a516d4163636a590","entry":"extract_first_digit","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/generate_QPP_scores.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/generate_QPP_scores.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a516d4163636a590"}},{"code_sha256_prefix":"e08cad149be1d1ab","entry":"f1_score","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/evaluation.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e08cad149be1d1ab"}},{"code_sha256_prefix":"0bbe88e1e97834eb","entry":"get_embedding","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/construct_indicators.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/construct_indicators.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0bbe88e1e97834eb"}},{"code_sha256_prefix":"ae944771f0673fa8","entry":"load_imodel_and_iconfig_package","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/inference.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae944771f0673fa8"}},{"code_sha256_prefix":"2a83dab612562e4d","entry":"load_imodel_and_iconfig_package","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/train_parallel.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/train_parallel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a83dab612562e4d"}},{"code_sha256_prefix":"8033a98192281151","entry":"load_imodel_and_iconfig_package","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"utils/iniModel.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/utils/iniModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8033a98192281151"}},{"code_sha256_prefix":"24a31436a8dbd623","entry":"normalize_answer","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/evaluation.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24a31436a8dbd623"}},{"code_sha256_prefix":"7f3a7ddcef1209a7","entry":"parser_binary","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/generate_QPP_scores.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/generate_QPP_scores.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f3a7ddcef1209a7"}},{"code_sha256_prefix":"aa8d783be138ff41","entry":"parser_digit","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/generate_QPP_scores.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/generate_QPP_scores.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa8d783be138ff41"}},{"code_sha256_prefix":"aa4b9685f084f5f8","entry":"pload","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/RAG_dataset.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/RAG_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa4b9685f084f5f8"}},{"code_sha256_prefix":"155939bd2bae6551","entry":"pload","repo":"fengranMark/OpenDecoder","repo_kind":"found_in_text","path":"src/retrieval/construct_indicators.py","file_url":"https://github.com/fengranMark/OpenDecoder/blob/HEAD/src/retrieval/construct_indicators.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"155939bd2bae6551"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}