{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-18331","title":"Prune, Update and Trim: Robust Structured Pruning for Large Language Models","arxiv_id":"2605.18331","date":"2026-05-18","proceeding":null,"authors":["Diego Coello de Portugal Mecke","Tom Hanika","Lars Schmidt-Thieme"],"abstract":"Large Language Models (LLMs) have experienced significant growth and development in recent years. However, performing inference on LLMs remains costly, especially for long-context inference or in resource-constrained devices. This motivates the development of new post-training pruning (PTP) methods. These methods reduce LLMs' requirements by removing a substantial part of the model's parameters. The discarded weights are selected depending on their impact on the models performance. Current PTP methods prune the models by removing the less informative hidden nodes from the FFN layers, and the least important attention layers. We propose Putri, a PTP method that introduces three changes to the State-of-the-art. First, we update the un-pruned weights of the FFN to compensate for the introduced pruning error. Second, the FFN layers are pruned sequentially, taking into account the updates done to the previous layers. Third, instead of removing full attention layers, we remove individual attention-heads. We extend this method such that it can also address Grouped-Query Attention. In summary, Putri is a structure pruning method which remains simple while showing SOTA performance. Pruning experiments on multiple models with a wide variety of sparsity ranges and on different datasets, validate the generality of Putri. Notably, we demonstrate that, unlike previous methods, Putri can prune LLMs on extreme sparsity ratios. The code is available at: https://github.com/Coello-dev/Putri.","url_abs":"https://arxiv.org/abs/2605.18331","url_pdf":"https://arxiv.org/pdf/2605.18331","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.18331","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.18331"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Coello-dev/Putri","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":2,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"34a6685f77a5599c","entry":"collect_samples_with_join","repo":"Coello-dev/Putri","repo_kind":"found_in_text","path":"src/evopress.py","file_url":"https://github.com/Coello-dev/Putri/blob/HEAD/src/evopress.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"34a6685f77a5599c"}},{"code_sha256_prefix":"180ff2e831dc3cfd","entry":"compute_fitness","repo":"Coello-dev/Putri","repo_kind":"found_in_text","path":"src/evopress.py","file_url":"https://github.com/Coello-dev/Putri/blob/HEAD/src/evopress.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"180ff2e831dc3cfd"}},{"code_sha256_prefix":"78e5ae3f5c220df6","entry":"compute_kl_div","repo":"Coello-dev/Putri","repo_kind":"found_in_text","path":"src/evopress.py","file_url":"https://github.com/Coello-dev/Putri/blob/HEAD/src/evopress.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"78e5ae3f5c220df6"}},{"code_sha256_prefix":"dcb5a3c9a67c7970","entry":"evopress","repo":"Coello-dev/Putri","repo_kind":"found_in_text","path":"src/evopress.py","file_url":"https://github.com/Coello-dev/Putri/blob/HEAD/src/evopress.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dcb5a3c9a67c7970"}},{"code_sha256_prefix":"dc1a281e0db06ae9","entry":"selection","repo":"Coello-dev/Putri","repo_kind":"found_in_text","path":"src/evopress.py","file_url":"https://github.com/Coello-dev/Putri/blob/HEAD/src/evopress.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dc1a281e0db06ae9"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}