{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/what-do-you-mean-the-role-of-the-mean","title":"What do you Mean? The Role of the Mean Function in Bayesian Optimisation","arxiv_id":"2004.08349","date":"2020-04-17","proceeding":null,"authors":["George De Ath","Jonathan E. Fieldsend","Richard M. Everson"],"abstract":"Bayesian optimisation is a popular approach for optimising expensive black-box functions. The next location to be evaluated is selected via maximising an acquisition function that balances exploitation and exploration. Gaussian processes, the surrogate models of choice in Bayesian optimisation, are often used with a constant prior mean function equal to the arithmetic mean of the observed function values. We show that the rate of convergence can depend sensitively on the choice of mean function. We empirically investigate 8 mean functions (constant functions equal to the arithmetic mean, minimum, median and maximum of the observed function evaluations, linear, quadratic polynomials, random forests and RBF networks), using 10 synthetic test problems and two real-world problems, and using the Expected Improvement and Upper Confidence Bound acquisition functions. We find that for design dimensions $\\ge5$ using a constant mean function equal to the worst observed quality value is consistently the best choice on the synthetic problems considered. We argue that this worst-observed-quality function promotes exploitation leading to more rapid convergence. However, for the real-world tasks the more complex mean functions capable of modelling the fitness landscape may be effective, although there is no clearly optimum choice.","url_abs":"https://arxiv.org/abs/2004.08349v2","url_pdf":"https://arxiv.org/pdf/2004.08349v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"what-do-you-mean-the-role-of-the-mean","repo_url":"https://github.com/georgedeath/bomean","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"bayesian-optimisation","task_name":"Bayesian Optimisation"},{"task_slug":"gaussian-processes","task_name":"Gaussian Processes"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2004.08349","atlas_url":"https://app.syntology.ai/?focus=2004.08349","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.08349"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/georgedeath/bomean","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"official":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c8a4324046f598ed","entry":"generate_data_filename","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/util.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8a4324046f598ed"}},{"code_sha256_prefix":"ab56651ad7847bd4","entry":"generate_save_filename","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/util.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/util.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ab56651ad7847bd4"}},{"code_sha256_prefix":"bc065f4d39716aff","entry":"acq_func_getter","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/util.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc065f4d39716aff"}},{"code_sha256_prefix":"a5649edfadaa32a6","entry":"make_1thing","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/test_problems/push_world.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/test_problems/push_world.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5649edfadaa32a6"}},{"code_sha256_prefix":"03fd5a046119f6eb","entry":"make_base","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/test_problems/push_world.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/test_problems/push_world.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"03fd5a046119f6eb"}},{"code_sha256_prefix":"16ec59f1c3ac5771","entry":"simu_push_4D","repo":"georgedeath/bomean","repo_kind":"official","path":"bopt/test_problems/push_world.py","file_url":"https://github.com/georgedeath/bomean/blob/HEAD/bopt/test_problems/push_world.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"16ec59f1c3ac5771"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}