{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-11854","title":"Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training","arxiv_id":"2606.11854","date":"2026-06-10","proceeding":null,"authors":["Michal Chudoba","Sergey Alyaev","Petra Galuscakova","Tomasz Wiktorski"],"abstract":"There are two main Parameter-Efficient Fine-Tuning (PEFT) techniques for Large Language Models (LLMs). While Low-Rank Adaptation (LoRA) introduces additional weights between the LLM layers, Soft Prompting introduces additional fine-tuning-specific raw tokens to an LLM input. However, both require modification to the computational graphs of precompiled, preoptimized LLMs. As a result, neither is fully supported in high-throughput engines like vLLM. We propose fine-tuning with ART (Art-based Reinforcement Training). The method injects information into a frozen Multimodal Large Language Model (MLLM) by optimizing only its raw visual input, thus enabling the soft-token approach on pre-compiled computational graphs. It relies on backpropagation of gradients back into a plain pixel array and thus supports any fine-tuning objective. Moreover, the optimized visual input can be stylized as task-relevant computational artworks. The approach's effectiveness is confirmed for different sizes of a popular open Qwen architecture and for several textual benchmarks. Specifically, ART reaches accuracy competitive with LoRA across mathematics and structured-tool-use benchmarks.","url_abs":"https://arxiv.org/abs/2606.11854","url_pdf":"https://arxiv.org/pdf/2606.11854","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.11854","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.11854"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/jinymusim/ART","reach":null}],"summary":{"ran":11,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":15,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3738eecc2c276c96","entry":"benchmark_overrides","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/config.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"3738eecc2c276c96"}},{"code_sha256_prefix":"ccec131e1096cfc5","entry":"benchmark_slug","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/config.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ccec131e1096cfc5"}},{"code_sha256_prefix":"3fff308a9a62cf01","entry":"extract_answer_text","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/datasets/evaluation/exact_match.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/datasets/evaluation/exact_match.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"3fff308a9a62cf01"}},{"code_sha256_prefix":"ad5bf662315530bc","entry":"extract_numeric","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/datasets/evaluation/exact_match.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/datasets/evaluation/exact_match.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ad5bf662315530bc"}},{"code_sha256_prefix":"d826b5b1c0e637c6","entry":"extract_numeric_loose","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/datasets/evaluation/exact_match.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/datasets/evaluation/exact_match.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d826b5b1c0e637c6"}},{"code_sha256_prefix":"d20c26a8c4fd692e","entry":"load_image","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/modalities/image.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/modalities/image.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d20c26a8c4fd692e"}},{"code_sha256_prefix":"5852771cf291fe6d","entry":"load_image_text_model","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/model_loading.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/model_loading.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"5852771cf291fe6d"}},{"code_sha256_prefix":"e2ea59d8ffd7feee","entry":"model_slug","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/config.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e2ea59d8ffd7feee"}},{"code_sha256_prefix":"2f1112429b512a86","entry":"register_dataset","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/datasets/base.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/datasets/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2f1112429b512a86"}},{"code_sha256_prefix":"86d8604bdec33355","entry":"register_model","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/base.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"86d8604bdec33355"}},{"code_sha256_prefix":"f55e465a133b6b13","entry":"strip_thinking","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/local_client.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/local_client.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f55e465a133b6b13"}},{"code_sha256_prefix":"8c6d5abeff384032","entry":"apply_chat_template","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/chat_template.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/chat_template.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"8c6d5abeff384032"}},{"code_sha256_prefix":"9f394ef2b0e29eb6","entry":"load_processor","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/model_loading.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/model_loading.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9f394ef2b0e29eb6"}},{"code_sha256_prefix":"a7ea8eef39586799","entry":"numeric_reward","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/datasets/evaluation/reward_shaping.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/datasets/evaluation/reward_shaping.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"a7ea8eef39586799"}},{"code_sha256_prefix":"6c56b9126d1ce712","entry":"template_supports_thinking","repo":"jinymusim/ART","repo_kind":"found_in_text","path":"src/reasoning_with_art/models/chat_template.py","file_url":"https://github.com/jinymusim/ART/blob/HEAD/src/reasoning_with_art/models/chat_template.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6c56b9126d1ce712"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}