{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/relaxed-conformal-prediction-cascades-for","title":"Efficient Conformal Prediction via Cascaded Inference with Expanded Admission","arxiv_id":"2007.03114","date":"2020-07-06","proceeding":"ICLR 2021 1","authors":["Adam Fisch","Tal Schuster","Tommi Jaakkola","Regina Barzilay"],"abstract":"In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high probability, and is well-suited for many open-ended classification tasks. In the standard CP paradigm, the predicted set can often be unusably large and also costly to obtain. This is particularly pervasive in settings where the correct answer is not unique, and the number of total possible answers is high. We first expand the CP correctness criterion to allow for additional, inferred \"admissible\" answers, which can substantially reduce the size of the predicted set while still providing valid performance guarantees. Second, we amortize costs by conformalizing prediction cascades, in which we aggressively prune implausible labels early on by using progressively stronger classifiers -- again, while still providing valid performance guarantees. We demonstrate the empirical effectiveness of our approach for multiple applications in natural language processing and computational chemistry for drug discovery.","url_abs":"https://arxiv.org/abs/2007.03114v3","url_pdf":"https://arxiv.org/pdf/2007.03114v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"relaxed-conformal-prediction-cascades-for","repo_url":"https://github.com/ajfisch/conformal-cascades","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"computational-chemistry","task_name":"Computational chemistry"},{"task_slug":"conformal-prediction","task_name":"Conformal Prediction"},{"task_slug":"drug-discovery","task_name":"Drug Discovery"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"prediction-intervals","task_name":"Prediction Intervals"},{"task_slug":null,"task_name":"valid"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2007.03114","atlas_url":"https://app.syntology.ai/?focus=2007.03114","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.03114"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ajfisch/conformal-cascades","reach":null}],"summary":{"ran_honours":1,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"7f6a359eb715f95f","entry":"compute_pvalue","repo":"ajfisch/conformal-cascades","repo_kind":"official","path":"cpcascade/conformal.py","file_url":"https://github.com/ajfisch/conformal-cascades/blob/HEAD/cpcascade/conformal.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7f6a359eb715f95f"}},{"code_sha256_prefix":"8f2323c258fe2a4e","entry":"predict_ecdf","repo":"ajfisch/conformal-cascades","repo_kind":"official","path":"cpcascade/conformal.py","file_url":"https://github.com/ajfisch/conformal-cascades/blob/HEAD/cpcascade/conformal.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8f2323c258fe2a4e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}