{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-11948","title":"Insights on Muon from Simple Quadratics","arxiv_id":"2602.11948","date":"2026-02-12","proceeding":null,"authors":["Antoine Gonon","Andreea-Alexandra Muşat","Nicolas Boumal"],"abstract":"Muon updates weight matrices along (approximate) polar factors of the gradients and has shown strong empirical performance in large-scale training. Existing attempts at explaining its performance largely focus on single-step comparisons (on quadratic proxies) and worst-case guarantees that treat the inexactness of the polar-factor as a nuisance ``to be argued away''. We show that already on simple strongly convex functions such as $L(W)=\\frac12\\|W\\|_{\\text{F}}^2$, these perspectives are insufficient, suggesting that understanding Muon requires going beyond local proxies and pessimistic worst-case bounds. Instead, our analysis exposes two observations that already affect behavior on simple quadratics and are not well captured by prevailing abstractions: (i) approximation error in the polar step can qualitatively alter discrete-time dynamics and improve reachability and finite-time performance -- an effect practitioners exploit to tune Muon, but that existing theory largely treats as a pure accuracy compromise; and (ii) structural properties of the objective affect finite-budget constants beyond the prevailing conditioning-based explanations. Thus, any general theory covering these cases must either incorporate these ingredients explicitly or explain why they are irrelevant in the regimes of interest.","url_abs":"https://arxiv.org/abs/2602.11948","url_pdf":"https://arxiv.org/pdf/2602.11948","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.11948","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.11948"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/agonon/muon-on-quadratics","reach":null}],"summary":{"unverified":19},"by_repo_kind":{"found_in_text":{"samples":19,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ec53bb5c75652e76","entry":"build_instance","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/data.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ec53bb5c75652e76"}},{"code_sha256_prefix":"6319d8bd2ed13c09","entry":"build_results_by_kind","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"plot_improvement_bars.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/plot_improvement_bars.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"6319d8bd2ed13c09"}},{"code_sha256_prefix":"1af94b2c0fe0f0bf","entry":"compare","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/runner.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/runner.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1af94b2c0fe0f0bf"}},{"code_sha256_prefix":"15b2a1a2f7e72da8","entry":"extract_kind","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/plotting.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/plotting.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"15b2a1a2f7e72da8"}},{"code_sha256_prefix":"4f7610c619c3e3c2","entry":"find_instance_dirs","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"plot_A_eigs_row.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/plot_A_eigs_row.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"4f7610c619c3e3c2"}},{"code_sha256_prefix":"1bf7cdfa82f8b8cb","entry":"find_instance_dirs","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"plot_improvement_bars.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/plot_improvement_bars.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1bf7cdfa82f8b8cb"}},{"code_sha256_prefix":"5960dd486e0bc04a","entry":"grad_fro_norm","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/runner.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/runner.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"5960dd486e0bc04a"}},{"code_sha256_prefix":"552c1eb34631107b","entry":"load_eigs","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"plot_A_eigs_row.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/plot_A_eigs_row.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"552c1eb34631107b"}},{"code_sha256_prefix":"0b247f30af0fc801","entry":"make_X_from_singular_values","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/data.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"0b247f30af0fc801"}},{"code_sha256_prefix":"9ec7028f61ce34b2","entry":"make_algo_specs","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"main_experiments.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/main_experiments.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9ec7028f61ce34b2"}},{"code_sha256_prefix":"d740fafb9af74c9c","entry":"make_s","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/data.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d740fafb9af74c9c"}},{"code_sha256_prefix":"c21ba68ea456a1ad","entry":"make_scheduler_from_spec","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"main_experiments.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/main_experiments.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"c21ba68ea456a1ad"}},{"code_sha256_prefix":"7baca9b8aced0821","entry":"median_ranges_best_lr","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/plotting_improvement_bars.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/plotting_improvement_bars.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"7baca9b8aced0821"}},{"code_sha256_prefix":"54c444464a2705ee","entry":"newtonschulz5","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/projections.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/projections.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"54c444464a2705ee"}},{"code_sha256_prefix":"9910f7de9736cf8a","entry":"plot_family_drilldowns","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/plotting.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/plotting.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9910f7de9736cf8a"}},{"code_sha256_prefix":"1b5cec9a3492ff74","entry":"plot_traces_side_by_side","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/plotting.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/plotting.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1b5cec9a3492ff74"}},{"code_sha256_prefix":"22d4698f79ef6672","entry":"polar_exact","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/projections.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/projections.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"22d4698f79ef6672"}},{"code_sha256_prefix":"bb3178d49685d225","entry":"run","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/runner.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/runner.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"bb3178d49685d225"}},{"code_sha256_prefix":"f487c9785bb4e779","entry":"select_best_lr_run","repo":"agonon/muon-on-quadratics","repo_kind":"found_in_text","path":"muon/plotting_improvement_bars.py","file_url":"https://github.com/agonon/muon-on-quadratics/blob/HEAD/muon/plotting_improvement_bars.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f487c9785bb4e779"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}