{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/optuna-a-next-generation-hyperparameter","title":"Optuna: A Next-generation Hyperparameter Optimization Framework","arxiv_id":"1907.10902","date":"2019-07-25","proceeding":null,"authors":["Takuya Akiba","Shotaro Sano","Toshihiko Yanase","Takeru Ohta","Masanori Koyama"],"abstract":"The purpose of this study is to introduce new design-criteria for next-generation hyperparameter optimization software. The criteria we propose include (1) define-by-run API that allows users to construct the parameter search space dynamically, (2) efficient implementation of both searching and pruning strategies, and (3) easy-to-setup, versatile architecture that can be deployed for various purposes, ranging from scalable distributed computing to light-weight experiment conducted via interactive interface. In order to prove our point, we will introduce Optuna, an optimization software which is a culmination of our effort in the development of a next generation optimization software. As an optimization software designed with define-by-run principle, Optuna is particularly the first of its kind. We will present the design-techniques that became necessary in the development of the software that meets the above criteria, and demonstrate the power of our new design through experimental results and real world applications. Our software is available under the MIT license (https://github.com/pfnet/optuna/).","url_abs":"https://arxiv.org/abs/1907.10902v1","url_pdf":"https://arxiv.org/pdf/1907.10902v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/pfnet/optuna","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/Automunge/AutoMunge","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/crcrpar/benchmark-runner-ci","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/crcrpar/ci-example-execution","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/crcrpar/optuna-mirror","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/himkt/optuna-test-rtds","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/optuna/optuna","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/optuna/optuna-integration","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/rickyHong/optuna-repl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/yqian4/optuna","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"optuna-a-next-generation-hyperparameter","repo_url":"https://github.com/brethvoice/optuna_demo_MNIST","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"distributed-computing","task_name":"Distributed Computing"},{"task_slug":"hyperparameter-optimization","task_name":"Hyperparameter Optimization"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1907.10902","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.10902"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/himkt/optuna-test-rtds","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Automunge/AutoMunge","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/optuna/optuna","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/crcrpar/benchmark-runner-ci","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/brethvoice/optuna_demo_MNIST","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/optuna/optuna-integration","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yqian4/optuna","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rickyHong/optuna-repl","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/crcrpar/optuna-mirror","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/crcrpar/ci-example-execution","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/pfnet/optuna","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":20},"by_repo_kind":{"listed":{"samples":20,"ran":0,"repositories":6}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e0f487fc31fe6108","entry":"deprecated","repo":"crcrpar/benchmark-runner-ci","repo_kind":"listed","path":"optuna/_deprecated.py","file_url":"https://github.com/crcrpar/benchmark-runner-ci/blob/HEAD/optuna/_deprecated.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0f487fc31fe6108"}},{"code_sha256_prefix":"a4522433f0feab75","entry":"deprecated","repo":"himkt/optuna-test-rtds","repo_kind":"listed","path":"optuna/_deprecated.py","file_url":"https://github.com/himkt/optuna-test-rtds/blob/HEAD/optuna/_deprecated.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a4522433f0feab75"}},{"code_sha256_prefix":"60cf3f75bd76f271","entry":"deprecated_class","repo":"optuna/optuna","repo_kind":"listed","path":"optuna/_deprecated.py","file_url":"https://github.com/optuna/optuna/blob/HEAD/optuna/_deprecated.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"60cf3f75bd76f271"}},{"code_sha256_prefix":"68cb51930216821b","entry":"deprecated_func","repo":"optuna/optuna","repo_kind":"listed","path":"optuna/_deprecated.py","file_url":"https://github.com/optuna/optuna/blob/HEAD/optuna/_deprecated.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68cb51930216821b"}},{"code_sha256_prefix":"300c3cdb36c77934","entry":"distribution_to_json","repo":"optuna/optuna","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/optuna/optuna/blob/HEAD/optuna/distributions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"300c3cdb36c77934"}},{"code_sha256_prefix":"66869b51e32b5239","entry":"distribution_to_json","repo":"crcrpar/benchmark-runner-ci","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/crcrpar/benchmark-runner-ci/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66869b51e32b5239"}},{"code_sha256_prefix":"fb81f851b70620a5","entry":"distribution_to_json","repo":"rickyHong/optuna-repl","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/rickyHong/optuna-repl/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb81f851b70620a5"}},{"code_sha256_prefix":"dd56e0858ebc9987","entry":"experimental","repo":"crcrpar/benchmark-runner-ci","repo_kind":"listed","path":"optuna/_experimental.py","file_url":"https://github.com/crcrpar/benchmark-runner-ci/blob/HEAD/optuna/_experimental.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd56e0858ebc9987"}},{"code_sha256_prefix":"e50db8e806388c8f","entry":"experimental","repo":"yqian4/optuna","repo_kind":"listed","path":"optuna/_experimental.py","file_url":"https://github.com/yqian4/optuna/blob/HEAD/optuna/_experimental.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e50db8e806388c8f"}},{"code_sha256_prefix":"e8026cbbd4877929","entry":"get_all_study_summaries","repo":"rickyHong/optuna-repl","repo_kind":"listed","path":"optuna/study.py","file_url":"https://github.com/rickyHong/optuna-repl/blob/HEAD/optuna/study.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8026cbbd4877929"}},{"code_sha256_prefix":"27ed2fee554587a5","entry":"get_all_study_summaries","repo":"yqian4/optuna","repo_kind":"listed","path":"optuna/study.py","file_url":"https://github.com/yqian4/optuna/blob/HEAD/optuna/study.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"27ed2fee554587a5"}},{"code_sha256_prefix":"532d732793640190","entry":"get_logger","repo":"optuna/optuna","repo_kind":"listed","path":"optuna/logging.py","file_url":"https://github.com/optuna/optuna/blob/HEAD/optuna/logging.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"532d732793640190"}},{"code_sha256_prefix":"81f35f190d0b3aff","entry":"get_logger","repo":"crcrpar/benchmark-runner-ci","repo_kind":"listed","path":"optuna/logging.py","file_url":"https://github.com/crcrpar/benchmark-runner-ci/blob/HEAD/optuna/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81f35f190d0b3aff"}},{"code_sha256_prefix":"16d3274a2492ce12","entry":"get_logger","repo":"rickyHong/optuna-repl","repo_kind":"listed","path":"optuna/logging.py","file_url":"https://github.com/rickyHong/optuna-repl/blob/HEAD/optuna/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"16d3274a2492ce12"}},{"code_sha256_prefix":"2949bcda1225868b","entry":"get_logger","repo":"yqian4/optuna","repo_kind":"listed","path":"optuna/logging.py","file_url":"https://github.com/yqian4/optuna/blob/HEAD/optuna/logging.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2949bcda1225868b"}},{"code_sha256_prefix":"b62334a22f7ed6be","entry":"json_to_distribution","repo":"crcrpar/benchmark-runner-ci","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/crcrpar/benchmark-runner-ci/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b62334a22f7ed6be"}},{"code_sha256_prefix":"6ce00ad175b2cf6c","entry":"json_to_distribution","repo":"crcrpar/ci-example-execution","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/crcrpar/ci-example-execution/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6ce00ad175b2cf6c"}},{"code_sha256_prefix":"229382f84fdfc44b","entry":"json_to_distribution","repo":"himkt/optuna-test-rtds","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/himkt/optuna-test-rtds/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"229382f84fdfc44b"}},{"code_sha256_prefix":"79f8dae8e1591e73","entry":"json_to_distribution","repo":"rickyHong/optuna-repl","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/rickyHong/optuna-repl/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"79f8dae8e1591e73"}},{"code_sha256_prefix":"8b51061ba35119e6","entry":"json_to_distribution","repo":"yqian4/optuna","repo_kind":"listed","path":"optuna/distributions.py","file_url":"https://github.com/yqian4/optuna/blob/HEAD/optuna/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8b51061ba35119e6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}