{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-12370","title":"Context Convergence Improves Answering Inferential Questions","arxiv_id":"2605.12370","date":"2026-05-12","proceeding":null,"authors":["Jamshid Mozafari","Bhawna Piryani","Adam Jatowt"],"abstract":"While Large Language Models (LLMs) are widely used in open-domain Question Answering (QA), their ability to handle inferential questions-where answers must be derived rather than directly retrieved-remains still underexplored. This study investigates how the structure and quality of passages influence LLM performance on such questions. We focus on convergence, a measure of how effectively sentences (hints) eliminate incorrect answers, as a criterion for constructing passages. Using subsets of the TriviaHG dataset, we form passages by combining sentences with varying convergence levels and evaluate six LLMs of different sizes and architectures. Our results show that passages built from higher convergence sentences lead to substantially better answer accuracy than those selected by cosine similarity, indicating that convergence captures meaningful relevance for inferential reasoning. Additionally, ordering sentences by descending convergence slightly improves performance, suggesting that LLMs tend to prioritize earlier, information-rich cues. These findings highlight convergence as a practical signal for guiding passage construction and analyzing inferential reasoning behavior in LLMs.","url_abs":"https://arxiv.org/abs/2605.12370","url_pdf":"https://arxiv.org/pdf/2605.12370","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2605.12370","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.12370"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA","reach":null}],"summary":{"ran":8,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":10,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"00cd605961e682c5","entry":"compute_em","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"experiments/convergence_vs_cosine.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/experiments/convergence_vs_cosine.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00cd605961e682c5"}},{"code_sha256_prefix":"f3af4fee5d8f78eb","entry":"compute_final_similarities","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/compute_similarities.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/compute_similarities.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f3af4fee5d8f78eb"}},{"code_sha256_prefix":"aebd1ca920951520","entry":"compute_hint_similarity","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/compute_similarities.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/compute_similarities.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aebd1ca920951520"}},{"code_sha256_prefix":"3f7e8fc166782345","entry":"compute_precision","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"experiments/convergence_vs_cosine.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/experiments/convergence_vs_cosine.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f7e8fc166782345"}},{"code_sha256_prefix":"3c261861a268a2a0","entry":"compute_recall","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"experiments/convergence_vs_cosine.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/experiments/convergence_vs_cosine.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c261861a268a2a0"}},{"code_sha256_prefix":"48dfcdcf1cc2ab16","entry":"convergence","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/make_dataset.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/make_dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48dfcdcf1cc2ab16"}},{"code_sha256_prefix":"6c2d1175b35dd57c","entry":"generate_orders","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/make_dataset.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/make_dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c2d1175b35dd57c"}},{"code_sha256_prefix":"88ebee314d0a5144","entry":"make_dataset","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/make_dataset.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/make_dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88ebee314d0a5144"}},{"code_sha256_prefix":"ccb09f79705369bd","entry":"analyze","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"experiments/order.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/experiments/order.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ccb09f79705369bd"}},{"code_sha256_prefix":"14faf83badd94cc4","entry":"compute_cosine_similarity","repo":"DataScienceUIBK/Context-Convergence-Inferential-QA","repo_kind":"found_in_text","path":"dataset/compute_similarities.py","file_url":"https://github.com/DataScienceUIBK/Context-Convergence-Inferential-QA/blob/HEAD/dataset/compute_similarities.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"14faf83badd94cc4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,795 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6795},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}