{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-11509","title":"Multimodal Fact-Level Attribution for Verifiable Reasoning","arxiv_id":"2602.11509","date":"2026-02-12","proceeding":"ICML","authors":["David Wan","Han Wang","Ziyang Wang","Elias Stengel-Eskin","Hyunji Lee","Mohit Bansal"],"abstract":"Multimodal large language models (MLLMs) are increasingly used for real-world tasks involving multi-step reasoning and long-form generation, where reliability requires grounding model outputs in heterogeneous input sources and verifying individual factual claims. However, existing multimodal grounding benchmarks and evaluation methods focus on simplified, observation-based scenarios or limited modalities and fail to assess attribution in complex multimodal reasoning. We introduce MuRGAt (Multimodal Reasoning with Grounded Attribution), a benchmark for evaluating fact-level multimodal attribution in settings that require reasoning beyond direct observation. Given inputs spanning video, audio, and other modalities, MuRGAt requires models to generate answers with explicit reasoning and precise citations, where each citation specifies both modality and temporal segments. To enable reliable assessment, we introduce an automatic evaluation framework that strongly correlates with human judgments. Benchmarking with human and automated scores reveals that even strong MLLMs frequently hallucinate citations despite correct reasoning. Moreover, we observe a key trade-off: increasing reasoning depth or enforcing structured grounding often degrades accuracy, highlighting a significant gap between internal reasoning and verifiable attribution.","url_abs":"https://arxiv.org/abs/2602.11509","url_pdf":"https://arxiv.org/pdf/2602.11509","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2602.11509","atlas_url":"https://app.syntology.ai/?focus=2602.11509","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.11509"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/meetdavidwan/murgat","reach":null}],"summary":{"unverified":10},"by_repo_kind":{"found_in_text":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"be9226ad1c9eb191","entry":"adapt_messages_to_openai","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/models.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be9226ad1c9eb191"}},{"code_sha256_prefix":"62fd78c059d6e0d2","entry":"clean_model_output","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/util.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"62fd78c059d6e0d2"}},{"code_sha256_prefix":"ca419c78d00ec1d5","entry":"extract_answer","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/util.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ca419c78d00ec1d5"}},{"code_sha256_prefix":"c73b835b7cc1c78c","entry":"extract_reasoning","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/util.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c73b835b7cc1c78c"}},{"code_sha256_prefix":"8915161a27a1d8d4","entry":"format_sentence_prompt","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/run_metric.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/run_metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8915161a27a1d8d4"}},{"code_sha256_prefix":"bbc3dbff8b3c7095","entry":"get_unique_key","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/run_baseline.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/run_baseline.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bbc3dbff8b3c7095"}},{"code_sha256_prefix":"f8d44f2e394301ff","entry":"load_prompt","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/program_utils.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/program_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8d44f2e394301ff"}},{"code_sha256_prefix":"99ba1590f3b6d46a","entry":"load_prompt_text","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/run_metric.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/run_metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"99ba1590f3b6d46a"}},{"code_sha256_prefix":"ac50d2af5d76c846","entry":"retry_with_backoff","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/program_utils.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/program_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac50d2af5d76c846"}},{"code_sha256_prefix":"e0500984ed50d79a","entry":"safe_generate","repo":"meetdavidwan/murgat","repo_kind":"found_in_text","path":"src/program_utils.py","file_url":"https://github.com/meetdavidwan/murgat/blob/HEAD/src/program_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0500984ed50d79a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}