{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-24025","title":"Towards Large Model Feature Coding","arxiv_id":"2605.24025","date":"2026-05-20","proceeding":null,"authors":["Youwei Pang","Changsheng Gao","Dong Liu","Huchuan Lu","Weisi Lin"],"abstract":"Large models have delivered remarkable performance across a wide range of perception and generation tasks, yet practical deployment is increasingly constrained by computational and memory budgets, as well as privacy requirements. Split execution alleviates these constraints by partitioning computation across devices, but it inevitably introduces intensive transmission and storage of intermediate features. Unlike conventional feature coding for CNNs that typically targets homogeneous spatial activation maps, modern large models generate heterogeneous features with varying statistical distributions and compression tolerances, e.g., multi-level/multi-modal representations and autoregressive context caches. These characteristics necessitate treating large model feature coding (LaMoFC) as a fundamental system component and call for a systematic evaluation framework. In this paper, we present a comprehensive benchmark and evaluation framework for LaMoFC. We first build the feature dataset LaMoFCBench, covering diverse task requirements across 4 categories and 16 scenarios while integrating widelyadopted architectures and various split-computing settings. We then specify representative split points according to practical application scenarios to extract intermediate features, establishing a unified pipeline for fair and reproducible comparisons. Finally, we benchmark mainstream universal feature codecs, exposing the profound misalignment between existing coding paradigms and the heterogeneous nature of large model features. These findings reveal that LaMoFC demands a fundamental departure from existing paradigms, and LaMoFCBench provides the shared empirical foundation to drive this transition. The data and code will be available at https://github.com/lartpang/LaMoFCBench.","url_abs":"https://arxiv.org/abs/2605.24025","url_pdf":"https://arxiv.org/pdf/2605.24025","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.24025","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.24025"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/lartpang/LaMoFCBench","reach":null}],"summary":{"ran":4,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":7,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"7bc1cfc42c5f29ea","entry":"check_sample_correctness","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"machine/clu/falconmamba.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/machine/clu/falconmamba.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7bc1cfc42c5f29ea"}},{"code_sha256_prefix":"2c3dfc1cb48ff18e","entry":"compute_mse","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"lmfc_utils/handlers/utils.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/lmfc_utils/handlers/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2c3dfc1cb48ff18e"}},{"code_sha256_prefix":"f3209adc1aab31f2","entry":"nonlinear_quantization","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"coding/benchmark.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/coding/benchmark.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f3209adc1aab31f2"}},{"code_sha256_prefix":"0d955aab70310d39","entry":"to_export_recursive","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"machine/cau/kimiaudio.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/machine/cau/kimiaudio.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0d955aab70310d39"}},{"code_sha256_prefix":"0912b94c7bf97414","entry":"load_per_key_quantization_points","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"coding/benchmark.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/coding/benchmark.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0912b94c7bf97414"}},{"code_sha256_prefix":"1feea961884ff15a","entry":"load_quantization_points","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"coding/benchmark.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/coding/benchmark.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1feea961884ff15a"}},{"code_sha256_prefix":"28b6bda85e455750","entry":"print_performance_table","repo":"lartpang/LaMoFCBench","repo_kind":"found_in_text","path":"machine/cau/kimiaudio.py","file_url":"https://github.com/lartpang/LaMoFCBench/blob/HEAD/machine/cau/kimiaudio.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"28b6bda85e455750"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}