{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/advancing-bayesian-optimization-via-learning-1","title":"Advancing Bayesian Optimization via Learning Correlated Latent Space","arxiv_id":"2310.20258","date":"2023-10-31","proceeding":"NeurIPS 2023 11","authors":["Seunghun Lee","Jaewon Chu","Sihyeon Kim","Juyeon Ko","Hyunwoo J. Kim"],"abstract":"Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders leads to effective and efficient Bayesian optimization for structured or discrete data. However, as the optimization does not take place in the input space, it leads to an inherent gap that results in potentially suboptimal solutions. To alleviate the discrepancy, we propose Correlated latent space Bayesian Optimization (CoBO), which focuses on learning correlated latent spaces characterized by a strong correlation between the distances in the latent space and the distances within the objective function. Specifically, our method introduces Lipschitz regularization, loss weighting, and trust region recoordination to minimize the inherent gap around the promising areas. We demonstrate the effectiveness of our approach on several optimization tasks in discrete data, such as molecule design and arithmetic expression fitting, and achieve high performance within a small budget.","url_abs":"https://arxiv.org/abs/2310.20258v3","url_pdf":"https://arxiv.org/pdf/2310.20258v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"advancing-bayesian-optimization-via-learning-1","repo_url":"https://github.com/mlvlab/CoBO","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"advancing-bayesian-optimization-via-learning-1","repo_url":"https://github.com/mlvlab/invbo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2310.20258","atlas_url":"https://app.syntology.ai/?focus=2310.20258","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.20258"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mlvlab/invbo","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mlvlab/CoBO","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":7},"by_repo_kind":{"official":{"samples":10,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"61a73be28a3229ec","entry":"compute_train_zs","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/mol_utils/load_data.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/mol_utils/load_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61a73be28a3229ec"}},{"code_sha256_prefix":"5b05e8e843deabaf","entry":"gumbel_softmax","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/mol_utils/selfies_vae/model_positional_unbounded.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/mol_utils/selfies_vae/model_positional_unbounded.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5b05e8e843deabaf"}},{"code_sha256_prefix":"f8e7af52c159f99d","entry":"is_valid_molecule","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/mol_utils/selfies_vae/model_positional_unbounded.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/mol_utils/selfies_vae/model_positional_unbounded.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8e7af52c159f99d"}},{"code_sha256_prefix":"a1d32b710e32cd21","entry":"generate_batch","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/bo_utils/turbo.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/bo_utils/turbo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1d32b710e32cd21"}},{"code_sha256_prefix":"98cfe3d3a797ae62","entry":"lipschitz_loss","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/utils.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98cfe3d3a797ae62"}},{"code_sha256_prefix":"dc3774d0bdbe2e6b","entry":"load_molecule_train_data","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/mol_utils/load_data.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/mol_utils/load_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc3774d0bdbe2e6b"}},{"code_sha256_prefix":"e00ccb61913dc9fb","entry":"load_train_z","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/mol_utils/load_data.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/mol_utils/load_data.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e00ccb61913dc9fb"}},{"code_sha256_prefix":"75d4f55ca9e56683","entry":"update_models_end_to_end","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/utils.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75d4f55ca9e56683"}},{"code_sha256_prefix":"ba51f9dac22959af","entry":"update_state","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/bo_utils/turbo.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/bo_utils/turbo.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba51f9dac22959af"}},{"code_sha256_prefix":"0dda692b10a19709","entry":"update_surr_model","repo":"mlvlab/CoBO","repo_kind":"official","path":"cobo/utils/utils.py","file_url":"https://github.com/mlvlab/CoBO/blob/HEAD/cobo/utils/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0dda692b10a19709"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}