{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/calculating-certainty-in-decision-trees","title":"Calculating certainty in decision trees: Certainty vs Entropy.","arxiv_id":null,"date":"2021-11-12","proceeding":"Unpublished 2021 11","authors":["Alejandro Penate-Diaz"],"abstract":"This research introduces a certainty function, to replace the entropy function used to calculate information gain when building decision trees, in algorithms like ID3[1], C4.5[2] and C5.0. The new function is simpler than the entropy function and calculates certainty more accurately, potentially consuming less time in the process.\r\nI will also introduce another formula that help deal with causal analysis. It is the certainty-raising inequality. This formula can be derived from the original certainty function, and provide insights into the cause-effect relations in the data.","url_abs":"https://github.com/alexwareb9/cid3/blob/master/paper.pdf","url_pdf":"https://github.com/alexwareb9/cid3/blob/master/paper.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"calculating-certainty-in-decision-trees","repo_url":"https://github.com/alexwareb9/cid3","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}