{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-02268","title":"SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization","arxiv_id":"2604.02268","date":"2026-04-02","proceeding":null,"authors":["Zhengxi Lu","Zhiyuan Yao","Jinyang Wu","Chengcheng Han","Qi Gu","Xunliang Cai","Weiming Lu","Jun Xiao","Yueting Zhuang","Yongliang Shen"],"abstract":"Agent skills, structured packages of procedural knowledge and executable resources that agents dynamically load at inference time, have become a reliable mechanism for augmenting LLM agents. Yet inference-time skill augmentation is fundamentally limited: retrieval noise introduces irrelevant guidance, injected skill content imposes substantial token overhead, and the model never truly acquires the knowledge it merely follows. We ask whether skills can instead be internalized into model parameters, enabling zero-shot autonomous behavior without any runtime skill retrieval. We introduce SKILL0, an in-context reinforcement learning framework designed for skill internalization. SKILL0 introduces a training-time curriculum that begins with full skill context and progressively withdraws it. Skills are grouped offline by category and rendered with interaction history into a compact visual context, teaching he model tool invocation and multi-turn task completion. A Dynamic Curriculum then evaluates each skill file's on-policy helpfulness, retaining only those from which the current policy still benefits within a linearly decaying budget, until the agent operates in a fully zero-shot setting. Extensive agentic experiments demonstrate that SKILL0 achieves substantial improvements over the standard RL baseline (+9.7\\% for ALFWorld, +6.6\\% for Search-QA, and+10.1\\% for WebShop), while maintaining a highly efficient context of fewer than 0.5k tokens per step. Our code is available at https://github.com/ZJU-REAL/SkillZero.","url_abs":"https://arxiv.org/abs/2604.02268","url_pdf":"https://arxiv.org/pdf/2604.02268","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2604.02268","atlas_url":"https://app.syntology.ai/?focus=2604.02268","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.02268"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ZJU-REAL/SkillZero","reach":null}],"summary":{"ran_violates":1,"ran_draft_wrong":3,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0588eb70d1fa7310","entry":"are_similar","repo":"ZJU-REAL/SkillZero","repo_kind":"found_in_text","path":"gigpo/core_gigpo.py","file_url":"https://github.com/ZJU-REAL/SkillZero/blob/HEAD/gigpo/core_gigpo.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0588eb70d1fa7310"}},{"code_sha256_prefix":"49e5a412f919c93f","entry":"build_step_group","repo":"ZJU-REAL/SkillZero","repo_kind":"found_in_text","path":"gigpo/core_gigpo.py","file_url":"https://github.com/ZJU-REAL/SkillZero/blob/HEAD/gigpo/core_gigpo.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"none","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"49e5a412f919c93f"}},{"code_sha256_prefix":"c86cbeaccc57dedb","entry":"episode_norm_reward","repo":"ZJU-REAL/SkillZero","repo_kind":"found_in_text","path":"gigpo/core_gigpo.py","file_url":"https://github.com/ZJU-REAL/SkillZero/blob/HEAD/gigpo/core_gigpo.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c86cbeaccc57dedb"}},{"code_sha256_prefix":"9c73a45de38c07e2","entry":"step_norm_reward","repo":"ZJU-REAL/SkillZero","repo_kind":"found_in_text","path":"gigpo/core_gigpo.py","file_url":"https://github.com/ZJU-REAL/SkillZero/blob/HEAD/gigpo/core_gigpo.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9c73a45de38c07e2"}},{"code_sha256_prefix":"76f7db977dc304c0","entry":"compute_gigpo_outcome_advantage","repo":"ZJU-REAL/SkillZero","repo_kind":"found_in_text","path":"gigpo/core_gigpo.py","file_url":"https://github.com/ZJU-REAL/SkillZero/blob/HEAD/gigpo/core_gigpo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"76f7db977dc304c0"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}