{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-conformal-prediction-by-reweighting","title":"Adaptive Conformal Prediction by Reweighting Nonconformity Score","arxiv_id":"2303.12695","date":"2023-03-22","proceeding":null,"authors":["Salim I. Amoukou","Nicolas J. B Brunel"],"abstract":"Despite attractive theoretical guarantees and practical successes, Predictive Interval (PI) given by Conformal Prediction (CP) may not reflect the uncertainty of a given model. This limitation arises from CP methods using a constant correction for all test points, disregarding their individual uncertainties, to ensure coverage properties. To address this issue, we propose using a Quantile Regression Forest (QRF) to learn the distribution of nonconformity scores and utilizing the QRF's weights to assign more importance to samples with residuals similar to the test point. This approach results in PI lengths that are more aligned with the model's uncertainty. In addition, the weights learnt by the QRF provide a partition of the features space, allowing for more efficient computations and improved adaptiveness of the PI through groupwise conformalization. Our approach enjoys an assumption-free finite sample marginal and training-conditional coverage, and under suitable assumptions, it also ensures conditional coverage. Our methods work for any nonconformity score and are available as a Python package. We conduct experiments on simulated and real-world data that demonstrate significant improvements compared to existing methods.","url_abs":"https://arxiv.org/abs/2303.12695v2","url_pdf":"https://arxiv.org/pdf/2303.12695v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adaptive-conformal-prediction-by-reweighting","repo_url":"https://github.com/salimamoukou/acpi","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"conformal-prediction","task_name":"Conformal Prediction"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"quantile-regression","task_name":"quantile regression"}],"methods":[{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2303.12695","atlas_url":"https://app.syntology.ai/?focus=2303.12695","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.12695"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/salimamoukou/acpi","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e6569b8d6c1f6d9c","entry":"mu_model","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/datasets/datasets.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/datasets/datasets.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e6569b8d6c1f6d9c"}},{"code_sha256_prefix":"0d744528b64936c6","entry":"quantile_score","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/utils.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0d744528b64936c6"}},{"code_sha256_prefix":"9a2036f68f7101c1","entry":"safe_isinstance","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/utils.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a2036f68f7101c1"}},{"code_sha256_prefix":"7a09b849f1ff0ce7","entry":"sigma_model","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/datasets/datasets.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/datasets/datasets.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a09b849f1ff0ce7"}},{"code_sha256_prefix":"fac7cddee5b93f45","entry":"weighted_percentile","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/utils.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fac7cddee5b93f45"}},{"code_sha256_prefix":"52d714651aeffeb2","entry":"px_model","repo":"salimamoukou/acpi","repo_kind":"official","path":"acpi/datasets/datasets.py","file_url":"https://github.com/salimamoukou/acpi/blob/HEAD/acpi/datasets/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52d714651aeffeb2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}