{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-survey-and-benchmark-of-high-dimensional","title":"A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences","arxiv_id":"2406.04739","date":"2024-06-07","proceeding":null,"authors":["Miguel González-Duque","Richard Michael","Simon Bartels","Yevgen Zainchkovskyy","Søren Hauberg","Wouter Boomsma"],"abstract":"Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these tasks. Several methods for high-dimensional continuous and categorical Bayesian optimization have been proposed recently. However, our survey of the field reveals highly heterogeneous experimental set-ups across methods and technical barriers for the replicability and application of published algorithms to real-world tasks. To address these issues, we develop a unified framework to test a vast array of high-dimensional Bayesian optimization methods and a collection of standardized black-box functions representing real-world application domains in chemistry and biology. These two components of the benchmark are each supported by flexible, scalable, and easily extendable software libraries (poli and poli-baselines), allowing practitioners to readily incorporate new optimization objectives or discrete optimizers. Project website: https://machinelearninglifescience.github.io/hdbo_benchmark","url_abs":"https://arxiv.org/abs/2406.04739v2","url_pdf":"https://arxiv.org/pdf/2406.04739v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-survey-and-benchmark-of-high-dimensional","repo_url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"},{"task_slug":"drug-design","task_name":"Drug Design"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2406.04739","atlas_url":"https://app.syntology.ai/?focus=2406.04739","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.04739"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark","reach":{"status":"ok"}}],"summary":{"ran":3,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"394cf9f336db9e4f","entry":"compute_pretty_names_for_solvers","repo":"MachineLearningLifeScience/hdbo_benchmark","repo_kind":"official","path":"src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","file_url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark/blob/HEAD/src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"394cf9f336db9e4f"}},{"code_sha256_prefix":"b9944db559f5e784","entry":"select_runs","repo":"MachineLearningLifeScience/hdbo_benchmark","repo_kind":"official","path":"src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","file_url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark/blob/HEAD/src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b9944db559f5e784"}},{"code_sha256_prefix":"c2e3a0678086293a","entry":"summary_per_function","repo":"MachineLearningLifeScience/hdbo_benchmark","repo_kind":"official","path":"src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","file_url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark/blob/HEAD/src/hdbo_benchmark/results/print_tables_for_website_and_paper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c2e3a0678086293a"}},{"code_sha256_prefix":"b3381c7c4aa767e3","entry":"convert_data_to_dataframes","repo":"MachineLearningLifeScience/hdbo_benchmark","repo_kind":"official","path":"src/hdbo_benchmark/results/download_tables.py","file_url":"https://github.com/MachineLearningLifeScience/hdbo_benchmark/blob/HEAD/src/hdbo_benchmark/results/download_tables.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b3381c7c4aa767e3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}