{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/latent-bayesian-optimization-via","title":"Latent Bayesian Optimization via Autoregressive Normalizing Flows","arxiv_id":"2504.14889","date":"2025-04-21","proceeding":null,"authors":["Seunghun Lee","Jinyoung Park","Jaewon Chu","Minseo Yoon","Hyunwoo J. Kim"],"abstract":"Bayesian Optimization (BO) has been recognized for its effectiveness in optimizing expensive and complex objective functions. Recent advancements in Latent Bayesian Optimization (LBO) have shown promise by integrating generative models such as variational autoencoders (VAEs) to manage the complexity of high-dimensional and structured data spaces. However, existing LBO approaches often suffer from the value discrepancy problem, which arises from the reconstruction gap between input and latent spaces. This value discrepancy problem propagates errors throughout the optimization process, leading to suboptimal outcomes. To address this issue, we propose a Normalizing Flow-based Bayesian Optimization (NF-BO), which utilizes normalizing flow as a generative model to establish one-to-one encoding function from the input space to the latent space, along with its left-inverse decoding function, eliminating the reconstruction gap. Specifically, we introduce SeqFlow, an autoregressive normalizing flow for sequence data. In addition, we develop a new candidate sampling strategy that dynamically adjusts the exploration probability for each token based on its importance. Through extensive experiments, our NF-BO method demonstrates superior performance in molecule generation tasks, significantly outperforming both traditional and recent LBO approaches.","url_abs":"https://arxiv.org/abs/2504.14889v1","url_pdf":"https://arxiv.org/pdf/2504.14889v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"bayesian-optimization","task_name":"Bayesian Optimization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2504.14889","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2504.14889"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/mlvlab/NFBO","reach":null}],"summary":{"ran":3,"ran_draft_wrong":2,"unverified":5},"by_repo_kind":{"found_in_text":{"samples":10,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"286fef81041bcc87","entry":"Affine","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"286fef81041bcc87"}},{"code_sha256_prefix":"64dd8ac1c89277db","entry":"FeedForwardNet","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"64dd8ac1c89277db"}},{"code_sha256_prefix":"39d6ef8e60fbaf8d","entry":"MaskedHiddenLayer","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"39d6ef8e60fbaf8d"}},{"code_sha256_prefix":"be1b158e80f519fd","entry":"arccosh","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"be1b158e80f519fd"}},{"code_sha256_prefix":"6bfb9bc7fb12f724","entry":"arcsinh","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6bfb9bc7fb12f724"}},{"code_sha256_prefix":"fdb9f08be5056e98","entry":"AFLayer","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fdb9f08be5056e98"}},{"code_sha256_prefix":"e1e4f90d57939772","entry":"Flow","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e1e4f90d57939772"}},{"code_sha256_prefix":"b46c290b7bcf9a3b","entry":"MADE","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b46c290b7bcf9a3b"}},{"code_sha256_prefix":"4c9be0bfc4c13888","entry":"NLSq","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4c9be0bfc4c13888"}},{"code_sha256_prefix":"5dac7a80827c25f8","entry":"SCFLayer","repo":"mlvlab/NFBO","repo_kind":"found_in_text","path":"generative_model/model/seqflow/flows.py","file_url":"https://github.com/mlvlab/NFBO/blob/HEAD/generative_model/model/seqflow/flows.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5dac7a80827c25f8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}