{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-11444","title":"When Are Two Scores Better Than One? Investigating Ensembles of Diffusion Models","arxiv_id":"2601.11444","date":"2026-01-16","proceeding":null,"authors":["Raphaël Razafindralambo","Rémy Sun","Frédéric Precioso","Damien Garreau","Pierre-Alexandre Mattei"],"abstract":"Diffusion models now generate high-quality, diverse samples, with an increasing focus on more powerful models. Although ensembling is a well-known way to improve supervised models, its application to unconditional score-based diffusion models remains largely unexplored. In this work we investigate whether it provides tangible benefits for generative modelling. We find that while ensembling the scores generally improves the score-matching loss and model likelihood, it fails to consistently enhance perceptual quality metrics such as FID on image datasets. We confirm this observation across a breadth of aggregation rules using Deep Ensembles, Monte Carlo Dropout, on CIFAR-10 and FFHQ. We attempt to explain this discrepancy by investigating possible explanations, such as the link between score estimation and image quality. We also look into tabular data through random forests, and find that one aggregation strategy outperforms the others. Finally, we provide theoretical insights into the summing of score models, which shed light not only on ensembling but also on several model composition techniques (e.g. guidance).","url_abs":"https://arxiv.org/abs/2601.11444","url_pdf":"https://arxiv.org/pdf/2601.11444","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2601.11444","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.11444"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/rarazafin/score_diffusion_ensemble","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":4,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":9,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"6c419026e778dee2","entry":"get_data_inverse_scaler","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/datasets.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/datasets.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c419026e778dee2"}},{"code_sha256_prefix":"346d2e6cc8b48a5d","entry":"get_data_scaler","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/datasets.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/datasets.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"346d2e6cc8b48a5d"}},{"code_sha256_prefix":"a05b1d0cf3f508b4","entry":"register_corrector","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/sampling.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/sampling.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a05b1d0cf3f508b4"}},{"code_sha256_prefix":"473066ddf62a075a","entry":"register_predictor","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/sampling.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/sampling.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"473066ddf62a075a"}},{"code_sha256_prefix":"54a00db9aadf092f","entry":"classifier_fn_from_tfhub","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/evaluation.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"54a00db9aadf092f"}},{"code_sha256_prefix":"fd14d238ccd5f679","entry":"crop_resize","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/datasets.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fd14d238ccd5f679"}},{"code_sha256_prefix":"0bfcb6b2d940e393","entry":"get_div_fn","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/likelihood.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/likelihood.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0bfcb6b2d940e393"}},{"code_sha256_prefix":"a58facb8fe71823a","entry":"get_predictor","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/sampling.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/sampling.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a58facb8fe71823a"}},{"code_sha256_prefix":"b45ab263f8440954","entry":"load_dataset_stats","repo":"rarazafin/score_diffusion_ensemble","repo_kind":"found_in_text","path":"score_based_cifar10/evaluation.py","file_url":"https://github.com/rarazafin/score_diffusion_ensemble/blob/HEAD/score_based_cifar10/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b45ab263f8440954"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}