{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-23200","title":"Adaptive Mass-Segmented KV Compression for Long-Context Reasoning","arxiv_id":"2605.23200","date":"2026-05-22","proceeding":null,"authors":["Junzhe Yang","Xiaoyu Shen"],"abstract":"The linear growth of the Key-Value (KV) cache is a critical bottleneck in long-form LLM inference. Existing KV compression methods mitigate this by evicting tokens based on importance scores. However, we show that their reliance on global Top-k selection triggers Region Wipe-out: the severe eviction of contiguous reasoning blocks that derails logical coherence. To address this, we propose Adaptive Mass-Segmented (AMS) KV Compression, a framework that shifts the paradigm from token-level competition to region-aware quota allocation. AMS adaptively partitions the KV cache based on the spatial distribution of attention mass, ensuring structurally vital reasoning segments receive guaranteed memory quotas. To ensure stability during iterative decoding, an EMA-based smoothing mechanism is incorporated to prevent jitter in segment boundaries. Crucially, AMS is a universal plug-and-play layer that is orthogonal to existing scorers. It can be seamlessly integrated into representative methods such as TOVA, Expected Attention, KeyDiff, R-KV and TriAttention. AMS is also system-compatible with modern paged-KV serving frameworks such as vLLM, supporting efficient gather-and-compact KV execution without introducing additional steady-state attention overhead. Extensive experiments across a diverse suite of tasks, including mathematical reasoning (MATH500, AIME, GSM8K), code completion, open-domain QA, and sparse retrieval, demonstrate that AMS consistently mitigates structural fragmentation and boosts model performance.","url_abs":"https://arxiv.org/abs/2605.23200","url_pdf":"https://arxiv.org/pdf/2605.23200","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.23200","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.23200"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/EIT-NLP/AdaptiveMassSegment","reach":null}],"summary":{"ran":2,"ran_draft_wrong":1,"ran_fixture":2,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"47497fe6d3135214","entry":"ScorerPress","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"47497fe6d3135214"}},{"code_sha256_prefix":"7743f93621eb7a4a","entry":"SnapKVPress","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7743f93621eb7a4a"}},{"code_sha256_prefix":"9d90fef264047280","entry":"dequantize_layer","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9d90fef264047280"}},{"code_sha256_prefix":"cf7068666062b2b6","entry":"extract_keys_and_values","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cf7068666062b2b6"}},{"code_sha256_prefix":"ebf221129de571e8","entry":"get_prerope_query_states","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ebf221129de571e8"}},{"code_sha256_prefix":"d32b135a5c0ea95c","entry":"AdaptiveMassSegmentWrapperHeadPress","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d32b135a5c0ea95c"}},{"code_sha256_prefix":"b38326bf91935776","entry":"BasePress","repo":"EIT-NLP/AdaptiveMassSegment","repo_kind":"found_in_text","path":"kvpress/presses/adaptive_segment_head_press.py","file_url":"https://github.com/EIT-NLP/AdaptiveMassSegment/blob/HEAD/kvpress/presses/adaptive_segment_head_press.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b38326bf91935776"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}