{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/heuristic-dropout-an-efficient-regularization","title":"Heuristic Dropout: An Efficient Regularization Method for Medical Image Segmentation Models","arxiv_id":null,"date":"2022-05-23","proceeding":"International Conference on Acoustics, Speech and Signal Processing 2022 5","authors":["Dachuan Shi","Ruiyang Liu","Linmi Tao","Chun Yuan"],"abstract":"For medical image segmentation in a real scenario, the amount of accurate annotation data at the pixel level is typically small, which tends to cause an overfitting problem. This manuscript goes deep into the research of the Dropout algorithm, which is commonly used in neural networks to alleviate the overfitting problem. From the perspective of solving the co-adaptation problem, this manuscript explains the basic principles of the Dropout algorithm and discusses the existing limitations of its derivative methods. Furthermore, we propose a novel Heuristic Dropout algorithm to address these limitations. The proposed algorithm takes information entropy and variance as heuristic rules. It guides our algorithm to drop features suffering from co-adaptation problem more efficiently and thus can better alleviate the overfitting problem of small-scale medical image segmentation datasets. Experiments on medical image segmentation datasets and models show that the proposed algorithm significantly improves the performance of these models.","url_abs":"https://ieeexplore.ieee.org/abstract/document/9747409","url_pdf":"https://ieeexplore.ieee.org/abstract/document/9747409","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"heuristic-dropout-an-efficient-regularization","repo_url":"https://github.com/MindCode-4/code-12/tree/main/HeuristicDropout","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"heuristic-dropout-an-efficient-regularization","repo_url":"https://github.com/MindCode-4/code-7/tree/main/HeuristicDropout","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"heuristic-dropout-an-efficient-regularization","repo_url":"https://github.com/MindSpore-scientific-2/code-12/tree/main/HeuristicDropout","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"heuristic-dropout-an-efficient-regularization","repo_url":"https://github.com/mindspore-ai/contrib/tree/master/application/HeuristicDropout","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"heuristic-dropout-an-efficient-regularization","repo_url":"https://github.com/sdc17/HeuristicDropout","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}