{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-bias-variance-decomposition-for-ensembles","title":"A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasets","arxiv_id":"2402.03985","date":"2024-02-06","proceeding":null,"authors":["Ossi Räisä","Antti Honkela"],"abstract":"Recent studies have highlighted the benefits of generating multiple synthetic datasets for supervised learning, from increased accuracy to more effective model selection and uncertainty estimation. These benefits have clear empirical support, but the theoretical understanding of them is currently very light. We seek to increase the theoretical understanding by deriving bias-variance decompositions for several settings of using multiple synthetic datasets, including differentially private synthetic data. Our theory yields a simple rule of thumb to select the appropriate number of synthetic datasets in the case of mean-squared error and Brier score. We investigate how our theory works in practice with several real datasets, downstream predictors and error metrics. As our theory predicts, multiple synthetic datasets often improve accuracy, while a single large synthetic dataset gives at best minimal improvement, showing that our insights are practically relevant.","url_abs":"https://arxiv.org/abs/2402.03985v3","url_pdf":"https://arxiv.org/pdf/2402.03985v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-bias-variance-decomposition-for-ensembles","repo_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"model-selection","task_name":"Model Selection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.03985","atlas_url":"https://app.syntology.ai/?focus=2402.03985","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.03985"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"ran_honours":1,"unverified":1},"by_repo_kind":{"official":{"samples":12,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"131d9e48e28818cf","entry":"adult_reduced_discretisation","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/experiment_config.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/experiment_config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"131d9e48e28818cf"}},{"code_sha256_prefix":"12513a27a1865536","entry":"cdp_delta","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/cdp2adp.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/cdp2adp.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12513a27a1865536"}},{"code_sha256_prefix":"6026d9da4638c121","entry":"cdp_delta_standard","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/cdp2adp.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/cdp2adp.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6026d9da4638c121"}},{"code_sha256_prefix":"438c48170078d9e5","entry":"cdp_eps","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/cdp2adp.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/cdp2adp.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"438c48170078d9e5"}},{"code_sha256_prefix":"ef1ef33de7a9f882","entry":"downward_closure","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/aim.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/aim.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef1ef33de7a9f882"}},{"code_sha256_prefix":"a0f36b2b02e60d5c","entry":"generalized_em_scores","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/mechanism.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/mechanism.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0f36b2b02e60d5c"}},{"code_sha256_prefix":"73be1750da2ee3a5","entry":"is_classification","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/experiment_config.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/experiment_config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"73be1750da2ee3a5"}},{"code_sha256_prefix":"87f72fb6f142740c","entry":"pareto_efficient","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/mechanism.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/mechanism.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87f72fb6f142740c"}},{"code_sha256_prefix":"802df9e4d1beab55","entry":"powerset","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/aim/aim.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/aim/aim.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"802df9e4d1beab55"}},{"code_sha256_prefix":"92d5ddfb9acb81c2","entry":"tqdm_choice","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"92d5ddfb9acb81c2"}},{"code_sha256_prefix":"e3c6fd4fec348bcd","entry":"train_model_return_mse","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3c6fd4fec348bcd"}},{"code_sha256_prefix":"1e0c03c46fb5b6f0","entry":"get_oh_df","repo":"dpbayes/generative-ensemble-bias-variance-decomposition","repo_kind":"official","path":"lib/util.py","file_url":"https://github.com/dpbayes/generative-ensemble-bias-variance-decomposition/blob/HEAD/lib/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e0c03c46fb5b6f0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}