{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2607-26860","title":"Amortized Moment Matching for Visual Generation","arxiv_id":"2607.26860","date":"2026-07-29","proceeding":null,"authors":["Wenze Liu","Xintao Wang","Pengfei Wan","Xiangyu Yue"],"abstract":"We propose amortized moment matching, utilizing neural networks to learn data moments as distributional training signals. By casting diffusion denoisers through polynomial projections, we establish a general framework for moment amortization, revealing that an $n$-th degree projection explicitly identifies data moments up to order $n+1$. Derived from the tractable affine case, we instantiate the Amortized Fréchet Distance (AMFD) loss. Unlike FD-loss which relies on explicit marginal moment calculations, AMFD is able to dynamically learn conditional moments via an alternating, matrix-free optimization pipeline that effortlessly scales to high-dimensional data. When operating on global representation features, AMFD serves as a powerful post-training objective; empirically, its neural formulation yields more robust training dynamics than exact statistical matching, substantially surpassing the FD baseline on the FDr$^6$ metric and achieving superior one-step generation on ImageNet. Furthermore, it unlocks direct exploration within native generative spaces, suggesting that the first two moments can identify target distributions only in spaces with strong semantics. Finally, when scaled to text-to-image generation, the condition-aware nature of AMFD unlocks massive gains in instruction-following capabilities, enabling our one-step models to outperform their multi-step FLUX.2 [klein] 4B teachers on the GenEval benchmark while achieving on-par performance on PickScore. Code and checkpoints are available at https://github.com/poppuppy/amfd.","url_abs":"https://arxiv.org/abs/2607.26860","url_pdf":"https://arxiv.org/pdf/2607.26860","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2607.26860","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2607.26860"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/poppuppy/amfd","reach":null}],"summary":{"ran":4,"ran_draft_wrong":7,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":14,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"05012eadd72a8228","entry":"FinalLayer","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05012eadd72a8228"}},{"code_sha256_prefix":"a5aa1c73efa8c043","entry":"MlpEncoder","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5aa1c73efa8c043"}},{"code_sha256_prefix":"f30fdfe486557b0d","entry":"ResBlock","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f30fdfe486557b0d"}},{"code_sha256_prefix":"cea94e8ac480b940","entry":"TimestepEmbedder","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cea94e8ac480b940"}},{"code_sha256_prefix":"3826925bc69ec8ae","entry":"_feature_weight","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3826925bc69ec8ae"}},{"code_sha256_prefix":"f5cdbd173d3eb015","entry":"_linear_jvp","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f5cdbd173d3eb015"}},{"code_sha256_prefix":"5e8d57329a932536","entry":"_res_block_jvp","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e8d57329a932536"}},{"code_sha256_prefix":"6d387286c1a36592","entry":"_rms_norm_jvp","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d387286c1a36592"}},{"code_sha256_prefix":"cdb677f7d7465d2e","entry":"_silu_jvp","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cdb677f7d7465d2e"}},{"code_sha256_prefix":"4eecaf737de4b827","entry":"_time_vector","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4eecaf737de4b827"}},{"code_sha256_prefix":"ecd79b7183df6033","entry":"timestep_embedding","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ecd79b7183df6033"}},{"code_sha256_prefix":"e3e9e43ad63aec36","entry":"A_apply","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3e9e43ad63aec36"}},{"code_sha256_prefix":"288615e45e430105","entry":"AmortizedFDLoss","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"288615e45e430105"}},{"code_sha256_prefix":"361bb11a33d8b476","entry":"manual_mlp_jvp","repo":"poppuppy/amfd","repo_kind":"found_in_text","path":"models/amfd_loss.py","file_url":"https://github.com/poppuppy/amfd/blob/HEAD/models/amfd_loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"361bb11a33d8b476"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}