{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/generalized-optimal-sparse-decision-trees","title":"Generalized and Scalable Optimal Sparse Decision Trees","arxiv_id":"2006.08690","date":"2020-06-15","proceeding":"ICML 2020 1","authors":["Jimmy Lin","Chudi Zhong","Diane Hu","Cynthia Rudin","Margo Seltzer"],"abstract":"Decision tree optimization is notoriously difficult from a computational perspective but essential for the field of interpretable machine learning. Despite efforts over the past 40 years, only recently have optimization breakthroughs been made that have allowed practical algorithms to find optimal decision trees. These new techniques have the potential to trigger a paradigm shift where it is possible to construct sparse decision trees to efficiently optimize a variety of objective functions without relying on greedy splitting and pruning heuristics that often lead to suboptimal solutions. The contribution in this work is to provide a general framework for decision tree optimization that addresses the two significant open problems in the area: treatment of imbalanced data and fully optimizing over continuous variables. We present techniques that produce optimal decision trees over a variety of objectives including F-score, AUC, and partial area under the ROC convex hull. We also introduce a scalable algorithm that produces provably optimal results in the presence of continuous variables and speeds up decision tree construction by several orders of magnitude relative to the state-of-the art.","url_abs":"https://arxiv.org/abs/2006.08690v4","url_pdf":"https://arxiv.org/pdf/2006.08690v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"generalized-optimal-sparse-decision-trees","repo_url":"https://github.com/Jimmy-Lin/GeneralizedOptimalSparseDecisionTrees","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"generalized-optimal-sparse-decision-trees","repo_url":"https://github.com/zhichen96/interpretable_ml_metamaterials","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"interpretable-machine-learning","task_name":"Interpretable Machine Learning"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.08690","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.08690"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Jimmy-Lin/GeneralizedOptimalSparseDecisionTrees","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhichen96/interpretable_ml_metamaterials","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":6},"by_repo_kind":{"listed":{"samples":9,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6378f6dece0a3ee1","entry":"get_false","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"gosdt/osdt_imb_v9.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/gosdt/osdt_imb_v9.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6378f6dece0a3ee1"}},{"code_sha256_prefix":"91a29b5d2f76fec8","entry":"get_fixed_false","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"gosdt/osdt_imb_v9.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/gosdt/osdt_imb_v9.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91a29b5d2f76fec8"}},{"code_sha256_prefix":"3124c55e58633650","entry":"get_split","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"gosdt/osdt_imb_v9.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/gosdt/osdt_imb_v9.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3124c55e58633650"}},{"code_sha256_prefix":"269762112549ddc2","entry":"bg_existence_labels","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"269762112549ddc2"}},{"code_sha256_prefix":"9e227a78a07c0705","entry":"binarize","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"create_bin_datasets.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/create_bin_datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e227a78a07c0705"}},{"code_sha256_prefix":"0b07f21520e6f2be","entry":"cart","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"gosdt/osdt_sup.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/gosdt/osdt_sup.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b07f21520e6f2be"}},{"code_sha256_prefix":"853df50d15ebc2ef","entry":"get_z","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"gosdt/osdt_sup.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/gosdt/osdt_sup.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"853df50d15ebc2ef"}},{"code_sha256_prefix":"268422e08b9dd3d2","entry":"shape_frequency_features","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"268422e08b9dd3d2"}},{"code_sha256_prefix":"f59d159f610c50ed","entry":"vector2symmatrix","repo":"zhichen96/interpretable_ml_metamaterials","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/zhichen96/interpretable_ml_metamaterials/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f59d159f610c50ed"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}