{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-24594","title":"Skill Retrieval Augmentation for Agentic AI","arxiv_id":"2604.24594","date":"2026-04-27","proceeding":null,"authors":["Weihang Su","Jianming Long","Qingyao Ai","Qiaozhi He","Yichen Tang","Changyue Wang","Yiteng Tu","Yingbo Wang","Yiqun Liu"],"abstract":"As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for incorporating skills is to explicitly enumerate available skills within the context window. However, this strategy fails to scale: as skill corpora expand, context budgets are consumed rapidly, and the agent becomes markedly less accurate in identifying the right skill. To this end, this paper formulates Skill Retrieval Augmentation (SRA), a new paradigm in which agents dynamically retrieve, incorporate, and apply relevant skills from large external skill corpora on demand. To make this problem measurable, we construct a large-scale skill corpus and introduce SRA-Bench, the first benchmark for decomposed evaluation of the full SRA pipeline, covering skill retrieval, skill incorporation, and end-task execution. SRA-Bench contains 5,400 capability-intensive test instances and 636 manually constructed gold skills, which are mixed with web-collected distractor skills to form a large-scale corpus of 26,262 skills. Extensive experiments show that retrieval-based skill augmentation can substantially improve agent performance, validating the promise of the paradigm. At the same time, we uncover a fundamental gap in skill incorporation: current LLM agents tend to load skills at similar rates, regardless of whether a gold skill is retrieved or whether the task actually requires external capabilities. This shows that the bottleneck in skill augmentation lies not only in retrieval but also in the base model's ability to determine which skill to load and when external loading is actually needed. These findings position SRA as a distinct research problem and establish a foundation for the scalable augmentation of capabilities in future agent systems.","url_abs":"https://arxiv.org/abs/2604.24594","url_pdf":"https://arxiv.org/pdf/2604.24594","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2604.24594","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.24594"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/oneal2000/SR-Agents","reach":null}],"summary":{"ran":7,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"44374d4475cf3603","entry":"get_extra_body","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/llm.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/llm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"44374d4475cf3603"}},{"code_sha256_prefix":"670a17988a65b567","entry":"model_short_name","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/config.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"670a17988a65b567"}},{"code_sha256_prefix":"6a9c8dba900d7923","entry":"parse_kv_list","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/cli/_common.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/cli/_common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a9c8dba900d7923"}},{"code_sha256_prefix":"d8a5014f185c57d7","entry":"register_prompt_builder","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/prompts.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/prompts.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d8a5014f185c57d7"}},{"code_sha256_prefix":"32185e61b3483664","entry":"require_exists","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/cli/_common.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/cli/_common.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"32185e61b3483664"}},{"code_sha256_prefix":"26d709a22e295aea","entry":"skill_text","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/corpus.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/corpus.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"26d709a22e295aea"}},{"code_sha256_prefix":"9fbd40b14b2e5c37","entry":"strip_think_tags","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/llm.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/llm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9fbd40b14b2e5c37"}},{"code_sha256_prefix":"87fb084b0ab65529","entry":"build_prompt","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/prompts.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/prompts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87fb084b0ab65529"}},{"code_sha256_prefix":"648c8fd2e6a0911f","entry":"get_builder","repo":"oneal2000/SR-Agents","repo_kind":"found_in_text","path":"src/sragents/prompts.py","file_url":"https://github.com/oneal2000/SR-Agents/blob/HEAD/src/sragents/prompts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"648c8fd2e6a0911f"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,795 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6795},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}