{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-07837","title":"Approximation-Free Differentiable Oblique Decision Trees","arxiv_id":"2605.07837","date":"2026-05-08","proceeding":null,"authors":["Subrat Prasad Panda","Blaise Genest","Arvind Easwaran"],"abstract":"Decision Trees (DTs) are widely used in safety-critical domains such as medical diagnosis, valued for their interpretability and effectiveness on tabular data. However, training accurate oblique DTs is challenging due to complex optimization landscapes and overfitting risks, particularly in regression. Recent advances have introduced differentiable formulations that enable gradient-based training and joint optimization of decision boundaries and leaf regressors. Yet, existing approaches typically rely on approximations, either through probabilistic softening of boundaries (soft DTs) or quantized gradients such as the Straight-Through Estimator (STE). To overcome these limitations, we propose DTSemNet, a novel, semantically equivalent, and invertible representation of hard oblique DTs as neural networks. DTSemNet enables end-to-end training with standard gradient descent, eliminating the need for approximations in both classification and regression. While classification aligns naturally with this formulation, regression remains challenging due to the joint optimization of internal nodes and leaf regressors. To address this, we analyze the limitations of STE and introduce an annealed Top-k method that provides accurate gradient signals without approximation. Extensive experiments on classification and regression benchmarks show that DTSemNet-trained oblique DTs outperform state-of-the-art differentiable DTs. Furthermore, we demonstrate that DTSemNet can serve as programmatic DT policies in reinforcement learning environments, thereby broadening their applicability.","url_abs":"https://arxiv.org/abs/2605.07837","url_pdf":"https://arxiv.org/pdf/2605.07837","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.07837","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.07837"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/CPS-research-group/dtsemnet","reach":null}],"summary":{"ran":3,"ran_draft_wrong":3},"by_repo_kind":{"found_in_text":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"47653a2e39a62076","entry":"DTSemNet","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"47653a2e39a62076"}},{"code_sha256_prefix":"c731c4aacddd8bf2","entry":"MaxPoolLayer","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c731c4aacddd8bf2"}},{"code_sha256_prefix":"4c77de44c8e5d42f","entry":"Sparser1","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c77de44c8e5d42f"}},{"code_sha256_prefix":"347b723f8647f1b6","entry":"genDT","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"347b723f8647f1b6"}},{"code_sha256_prefix":"12ff2bfb10430df1","entry":"generate_complete_binary_tree","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12ff2bfb10430df1"}},{"code_sha256_prefix":"cada2bb1f146aae7","entry":"generate_complete_binary_tree_custom","repo":"CPS-research-group/dtsemnet","repo_kind":"found_in_text","path":"src/dtsemnet.py","file_url":"https://github.com/CPS-research-group/dtsemnet/blob/HEAD/src/dtsemnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cada2bb1f146aae7"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}