{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/r1-onevision-advancing-generalized-multimodal","title":"R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization","arxiv_id":"2503.10615","date":"2025-03-13","proceeding":null,"authors":["Yi Yang","Xiaoxuan He","Hongkun Pan","Xiyan Jiang","Yan Deng","Xingtao Yang","Haoyu Lu","Dacheng Yin","Fengyun Rao","Minfeng Zhu","Bo Zhang","Wei Chen"],"abstract":"Large Language Models have demonstrated remarkable reasoning capability in complex textual tasks. However, multimodal reasoning, which requires integrating visual and textual information, remains a significant challenge. Existing visual-language models often struggle to effectively analyze and reason visual content, resulting in suboptimal performance on complex reasoning tasks. Moreover, the absence of comprehensive benchmarks hinders the accurate assessment of multimodal reasoning capabilities. In this paper, we introduce R1-Onevision, a multimodal reasoning model designed to bridge the gap between visual perception and deep reasoning. To achieve this, we propose a cross-modal reasoning pipeline that transforms images into formal textural representations, enabling precise language-based reasoning. Leveraging this pipeline, we construct the R1-Onevision dataset which provides detailed, step-by-step multimodal reasoning annotations across diverse domains. We further develop the R1-Onevision model through supervised fine-tuning and reinforcement learning to cultivate advanced reasoning and robust generalization abilities. To comprehensively evaluate multimodal reasoning performance across different grades, we introduce R1-Onevision-Bench, a benchmark aligned with human educational stages, covering exams from junior high school to university and beyond. Experimental results show that R1-Onevision achieves state-of-the-art performance, outperforming models such as GPT-4o and Qwen2.5-VL on multiple challenging multimodal reasoning benchmarks.","url_abs":"https://arxiv.org/abs/2503.10615v1","url_pdf":"https://arxiv.org/pdf/2503.10615v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"r1-onevision-advancing-generalized-multimodal","repo_url":"https://github.com/Fancy-MLLM/R1-onevision","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"multimodal-reasoning","task_name":"Multimodal Reasoning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2503.10615","atlas_url":"https://app.syntology.ai/?focus=2503.10615","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.10615"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Fancy-MLLM/R1-onevision","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"dbea5358be6b5ad0","entry":"create_score_evaluation_response","repo":"Fancy-MLLM/R1-onevision","repo_kind":"official","path":"LLaMA-Factory/src/llamafactory/api/chat.py","file_url":"https://github.com/Fancy-MLLM/R1-onevision/blob/HEAD/LLaMA-Factory/src/llamafactory/api/chat.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"dbea5358be6b5ad0"}},{"code_sha256_prefix":"57583cf880d95444","entry":"jsonify","repo":"Fancy-MLLM/R1-onevision","repo_kind":"official","path":"LLaMA-Factory/src/llamafactory/api/common.py","file_url":"https://github.com/Fancy-MLLM/R1-onevision/blob/HEAD/LLaMA-Factory/src/llamafactory/api/common.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"57583cf880d95444"}},{"code_sha256_prefix":"87aa9acaa81294f5","entry":"dictify","repo":"Fancy-MLLM/R1-onevision","repo_kind":"official","path":"LLaMA-Factory/src/llamafactory/api/common.py","file_url":"https://github.com/Fancy-MLLM/R1-onevision/blob/HEAD/LLaMA-Factory/src/llamafactory/api/common.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"87aa9acaa81294f5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}