{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/computing-valid-p-value-for-optimal","title":"Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programming","arxiv_id":"2002.09132","date":"2020-02-21","proceeding":"NeurIPS 2020 12","authors":["Vo Nguyen Le Duy","Hiroki Toda","Ryota Sugiyama","Ichiro Takeuchi"],"abstract":"There is a vast body of literature related to methods for detecting changepoints (CP). However, less attention has been paid to assessing the statistical reliability of the detected CPs. In this paper, we introduce a novel method to perform statistical inference on the significance of the CPs, estimated by a Dynamic Programming (DP)-based optimal CP detection algorithm. Based on the selective inference (SI) framework, we propose an exact (non-asymptotic) approach to compute valid p-values for testing the significance of the CPs. Although it is well-known that SI has low statistical power because of over-conditioning, we address this disadvantage by introducing parametric programming techniques. Then, we propose an efficient method to conduct SI with the minimum amount of conditioning, leading to high statistical power. We conduct experiments on both synthetic and real-world datasets, through which we offer evidence that our proposed method is more powerful than existing methods, has decent performance in terms of computational efficiency, and provides good results in many practical applications.","url_abs":"https://arxiv.org/abs/2002.09132v2","url_pdf":"https://arxiv.org/pdf/2002.09132v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"computing-valid-p-value-for-optimal","repo_url":"https://github.com/vonguyenleduy/parametric_selective_inference_changepoint","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"computing-valid-p-value-for-optimal","repo_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"computational-efficiency","task_name":"Computational Efficiency"},{"task_slug":null,"task_name":"valid"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2002.09132","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.09132"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/vonguyenleduy/parametric_selective_inference_changepoint","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp","reach":null}],"summary":{"ran_fixture":3,"ran_honours":2,"unverified":4},"by_repo_kind":{"listed":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"3aa9034e077ceae7","entry":"check_coef_zero","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"3aa9034e077ceae7"}},{"code_sha256_prefix":"8364752784838d91","entry":"check_min_q_term","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"8364752784838d91"}},{"code_sha256_prefix":"deac115682193ce7","entry":"check_zero","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"deac115682193ce7"}},{"code_sha256_prefix":"eeeab25fb510bd4d","entry":"quadratic_solver","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"eeeab25fb510bd4d"}},{"code_sha256_prefix":"f833b832d50e65e3","entry":"ssq","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f833b832d50e65e3"}},{"code_sha256_prefix":"d17543217575c42d","entry":"dp_parametrized_x","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d17543217575c42d"}},{"code_sha256_prefix":"18ebe02e340d2d46","entry":"fill_dp_matrix","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"18ebe02e340d2d46"}},{"code_sha256_prefix":"8f2cd2e21a00ed7e","entry":"fill_row_k","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"8f2cd2e21a00ed7e"}},{"code_sha256_prefix":"899c86d5b85a7eca","entry":"find_opt_funct_set","repo":"vonguyenleduy/parametric_si_optimal_cp_dp","repo_kind":"listed","path":"core_parametric_si_k_fixed/dp_parametrized_x.py","file_url":"https://github.com/vonguyenleduy/parametric_si_optimal_cp_dp/blob/HEAD/core_parametric_si_k_fixed/dp_parametrized_x.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"899c86d5b85a7eca"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}