{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-25832","title":"MiniOpt: Reasoning to Model and Solve General Optimization Problems with Limited Resources","arxiv_id":"2606.25832","date":"2026-06-24","proceeding":null,"authors":["Ke Zhao","Zixiang Di","Hong Qian","Xiang Shu","Yaolin Wen","Qitao Shi","Bingdong Li","Xingyu Lu","Xiangfeng Wang","Jun Zhou","Ke Tang","Yang Yu"],"abstract":"Achieving strong optimization generalization across diverse optimization problems while requiring limited training resources remains a challenging problem for optimization-oriented large language models (LLMs). Existing approaches typically rely on large-scale supervised datasets, costly reasoning annotations, and expensive intermediate step verification, resulting in substantial training overhead. To address these challenges, we propose MiniOpt, a reinforcement learning framework that learns to solve optimization problems through an \"reasoning-to-model-and-solve\" paradigm. MiniOpt decomposes optimization reasoning into structured optimization modeling and executable solver generation. Building upon this paradigm, we introduce OptReward, a reward function with hierarchical score structure that jointly evaluates formulation and solution, enabling effective policy learning without expert demonstrations. We further develop an optimization-oriented policy optimization strategy that improves exploration efficiency and stabilizes reinforcement learning for compact models. Extensive experiments show that MiniOpt-3B exhibits strong optimization generalization across various optimization types, problem scenarios, and task domains. For models with fewer than 10B parameters, MiniOpt series achieves the highest average solving accuracy (SA). For models with more than 10B parameters, MiniOpt still shows competitive performance. These results suggest that optimization-oriented reward design and reinforcement learning provide an effective pathway for developing compact optimization-specialized language models with strong optimization generalization capabilities. The code is available at https://github.com/Hsiang-1/MiniOpt.","url_abs":"https://arxiv.org/abs/2606.25832","url_pdf":"https://arxiv.org/pdf/2606.25832","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.25832","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.25832"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Hsiang-1/MiniOpt","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/antgroup/LLMOPT","reach":null}],"summary":{"ran":11,"ran_draft_wrong":5,"ran_violates":1,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":18,"ran":17,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":18,"samples":[{"code_sha256_prefix":"b36aa87ff3870104","entry":"PyomoExecutor","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b36aa87ff3870104"}},{"code_sha256_prefix":"11a20109d1d4cded","entry":"Q2C","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/generate_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/generate_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"11a20109d1d4cded"}},{"code_sha256_prefix":"424573ce442f730f","entry":"Q2F","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/generate_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/generate_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"424573ce442f730f"}},{"code_sha256_prefix":"c29fef2fb87e9fca","entry":"QF2C","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/generate_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/generate_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c29fef2fb87e9fca"}},{"code_sha256_prefix":"41f9c49df2146d47","entry":"aug_0","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/augment_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/augment_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"41f9c49df2146d47"}},{"code_sha256_prefix":"ed125bc4a9ffd75d","entry":"aug_1","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/augment_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/augment_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ed125bc4a9ffd75d"}},{"code_sha256_prefix":"d74190a8561fcb4d","entry":"aug_2","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/augment_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/augment_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d74190a8561fcb4d"}},{"code_sha256_prefix":"6897470becf3bcf2","entry":"classification_background","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/classification_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/classification_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6897470becf3bcf2"}},{"code_sha256_prefix":"1b8cb3d807bbac67","entry":"classification_type","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/classification_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/classification_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1b8cb3d807bbac67"}},{"code_sha256_prefix":"dd14950a6b76ffbc","entry":"extract_code","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dd14950a6b76ffbc"}},{"code_sha256_prefix":"aff277159c256439","entry":"extract_obj_value","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aff277159c256439"}},{"code_sha256_prefix":"cb34672dd4256cd2","entry":"preprocess","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb34672dd4256cd2"}},{"code_sha256_prefix":"d1b60aa8fe0416e6","entry":"preprocess","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"sft/sft.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/sft/sft.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d1b60aa8fe0416e6"}},{"code_sha256_prefix":"7150c50fb780ee87","entry":"run_pyomo_code","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7150c50fb780ee87"}},{"code_sha256_prefix":"31510c72b92d5555","entry":"run_pyomo_code_local","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"31510c72b92d5555"}},{"code_sha256_prefix":"763114f4e6850981","entry":"self_correction","repo":"antgroup/LLMOPT","repo_kind":"found_in_text","path":"prompts/self_correction_prompt.py","file_url":"https://github.com/antgroup/LLMOPT/blob/HEAD/prompts/self_correction_prompt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"763114f4e6850981"}},{"code_sha256_prefix":"571a70217fc3155f","entry":"validate_response_structure","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"571a70217fc3155f"}},{"code_sha256_prefix":"40bf1b9d93101713","entry":"compute_score_batched","repo":"Hsiang-1/MiniOpt","repo_kind":"found_in_text","path":"rl/opt_reward.py","file_url":"https://github.com/Hsiang-1/MiniOpt/blob/HEAD/rl/opt_reward.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"40bf1b9d93101713"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}