{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/quantifying-statistical-significance-of-1","title":"Quantifying Statistical Significance of Neural Network-based Image Segmentation by Selective Inference","arxiv_id":"2010.01823","date":"2020-10-05","proceeding":null,"authors":["Vo Nguyen Le Duy","Shogo Iwazaki","Ichiro Takeuchi"],"abstract":"Although a vast body of literature relates to image segmentation methods that use deep neural networks (DNNs), less attention has been paid to assessing the statistical reliability of segmentation results. In this study, we interpret the segmentation results as hypotheses driven by DNN (called DNN-driven hypotheses) and propose a method by which to quantify the reliability of these hypotheses within a statistical hypothesis testing framework. Specifically, we consider a statistical hypothesis test for the difference between the object and background regions. This problem is challenging, as the difference would be falsely large because of the adaptation of the DNN to the data. To overcome this difficulty, we introduce a conditional selective inference (SI) framework -- a new statistical inference framework for data-driven hypotheses that has recently received considerable attention -- to compute exact (non-asymptotic) valid p-values for the segmentation results. To use the conditional SI framework for DNN-based segmentation, we develop a new SI algorithm based on the homotopy method, which enables us to derive the exact (non-asymptotic) sampling distribution of DNN-driven hypothesis. We conduct experiments on both synthetic and real-world datasets, through which we offer evidence that our proposed method can successfully control the false positive rate, has good performance in terms of computational efficiency, and provides good results when applied to medical image data.","url_abs":"https://arxiv.org/abs/2010.01823v3","url_pdf":"https://arxiv.org/pdf/2010.01823v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"quantifying-statistical-significance-of-1","repo_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"quantifying-statistical-significance-of-1","repo_url":"https://github.com/vonguyenleduy/dnn_segmentation_selective_inference","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"computational-efficiency","task_name":"Computational Efficiency"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"hypothesis-testing","task_name":"Two-sample testing"},{"task_slug":null,"task_name":"valid"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2010.01823","atlas_url":"https://app.syntology.ai/?focus=2010.01823","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.01823"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/vonguyenleduy/dnn_segmentation_selective_inference","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference","reach":null}],"summary":{"ran_violates":2,"ran_fixture":2,"unverified":4},"by_repo_kind":{"official":{"samples":8,"ran":4,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"b8e95809ca2c17c9","entry":"sigmoid","repo":"vonguyenleduy/dnn_segmentation_selective_inference","repo_kind":"official","path":"util.py","file_url":"https://github.com/vonguyenleduy/dnn_segmentation_selective_inference/blob/HEAD/util.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":2,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b8e95809ca2c17c9"}},{"code_sha256_prefix":"a04c722f735c5adc","entry":"max_pooling","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a04c722f735c5adc"}},{"code_sha256_prefix":"f5224743494a3202","entry":"max_pooling_event","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f5224743494a3202"}},{"code_sha256_prefix":"362270874ed7f71c","entry":"up_sampling","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"362270874ed7f71c"}},{"code_sha256_prefix":"34709125e2897248","entry":"conv","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"34709125e2897248"}},{"code_sha256_prefix":"695151e404a20052","entry":"create_X_pad","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"695151e404a20052"}},{"code_sha256_prefix":"a5505e42566212ba","entry":"create_X_para","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a5505e42566212ba"}},{"code_sha256_prefix":"bce259dbdc11b263","entry":"run_parametric_si","repo":"vonguyenleduy/dnn_representation_selective_inference","repo_kind":"official","path":"parametric_si.py","file_url":"https://github.com/vonguyenleduy/dnn_representation_selective_inference/blob/HEAD/parametric_si.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bce259dbdc11b263"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}