{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-11045","title":"ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization","arxiv_id":"2608.11045","date":"2026-08-11","proceeding":null,"authors":["He-Yen Hsieh","H. T. Kung"],"abstract":"ReRound (Reconstructive Rounding) is a post-training quantization method that addresses the midpoint ambiguity inherent in standard round-to-nearest (RTN) schemes when quantizing weights near the centers of quantization intervals. Starting from a pretrained LLM, ReRound trains a conditional diffusion model to produce continuous reconstructions of low-bit weights for the LLM. These reconstructed weights act as a guidance signal to disambiguate the rounding direction of weights located close to interval midpoints. To integrate this reconstruction-guided rounding with conventional RTN, ReRound introduces a tolerance metric measuring how far the quantized weight (not the final quantized integer) is away from the midpoint: quantized weights within a tolerance region around midpoints are quantized using diffusion-based reconstructions, whereas weights closer to quantization boundaries are quantized with RTN. By sweeping the tolerance parameter, ReRound generates multiple candidate quantized integer weight matrices and selects the de-quantized weight matrix candidate whose leading singular values most closely match those of the original full-precision weights. This selected candidate determines the tolerance parameter ReRound uses. ReRound is particularly effective for smaller LLMs. Across a range of such models, it consistently outperforms standard RTN for 3-bit and 4-bit weight quantization. ReRound achieves superior accuracy compared to an extensive set of calibration-free methods, remains competitive with calibration-dependent approaches, and operates entirely offline, introducing no additional overhead during low-bit inference. The ReRound strategy represents a new approach for low-bit quantization. The method applies to AI models beyond LLMs. This paper focuses on its applications to small LLMs.","url_abs":"https://arxiv.org/abs/2608.11045","url_pdf":"https://arxiv.org/pdf/2608.11045","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2608.11045","atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.11045"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/louisYen/ReRound","reach":null}],"summary":{"ran":2,"ran_draft_wrong":10,"ran_honours":1,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":16,"ran":13,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"b291cd4474b2b0b1","entry":"ReRoundConfig","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b291cd4474b2b0b1"}},{"code_sha256_prefix":"99b7319828711fd6","entry":"ReRoundResult","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"99b7319828711fd6"}},{"code_sha256_prefix":"c7562eb1308b4f27","entry":"_candidate_name","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c7562eb1308b4f27"}},{"code_sha256_prefix":"18123e0d23912b0a","entry":"_find_rtn_loss","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"18123e0d23912b0a"}},{"code_sha256_prefix":"5b2e48474d839b75","entry":"_fmt_count","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b2e48474d839b75"}},{"code_sha256_prefix":"4f18cda286393324","entry":"_fmt_loss","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f18cda286393324"}},{"code_sha256_prefix":"678a26367f6214c4","entry":"_fmt_pct","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"678a26367f6214c4"}},{"code_sha256_prefix":"888fff0d92acfbe0","entry":"_format_reround_candidates","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"888fff0d92acfbe0"}},{"code_sha256_prefix":"bbcd1c1fdfa90aa4","entry":"_pick_tau_row","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bbcd1c1fdfa90aa4"}},{"code_sha256_prefix":"7d4f6860df13a8e5","entry":"_selection_name","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7d4f6860df13a8e5"}},{"code_sha256_prefix":"450db99d12ab9c3c","entry":"_status_text","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"450db99d12ab9c3c"}},{"code_sha256_prefix":"57b44820869a2d91","entry":"dequantize_from_bins","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"57b44820869a2d91"}},{"code_sha256_prefix":"38ff793e4abe8ad7","entry":"spectral_loss_from_q","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"38ff793e4abe8ad7"}},{"code_sha256_prefix":"c1dbcf5ff9ad4fba","entry":"_log_reround_selection","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c1dbcf5ff9ad4fba"}},{"code_sha256_prefix":"d6c73f1cfd6218c4","entry":"reround","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d6c73f1cfd6218c4"}},{"code_sha256_prefix":"88da9893deb0449e","entry":"select_reround_bins","repo":"louisYen/ReRound","repo_kind":"found_in_text","path":"reround_ptq/llm_quant/rounding.py","file_url":"https://github.com/louisYen/ReRound/blob/HEAD/reround_ptq/llm_quant/rounding.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"88da9893deb0449e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,885 of the 9,623 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9623,"papers_checked":6885},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}