{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-24704","title":"Conformal Selective Prediction with General Risk Control","arxiv_id":"2603.24704","date":"2026-03-25","proceeding":null,"authors":["Tian Bai","Ying Jin"],"abstract":"In deploying artificial intelligence (AI) models, selective prediction offers the option to abstain from making a prediction when uncertain about model quality. To fulfill its promise, it is crucial to enforce strict and precise error control over cases where the model is trusted. We propose Selective Conformal Risk control with E-values (SCoRE), a new framework for deriving such decisions for any trained model and any user-defined, bounded and continuously-valued risk. SCoRE offers two types of guarantees on the risk among ``positive'' cases in which the system opts to trust the model. Built upon conformal inference and hypothesis testing ideas, SCoRE first constructs a class of (generalized) e-values, which are non-negative random variables whose product with the unknown risk has expectation no greater than one. Such a property is ensured by data exchangeability without requiring any modeling assumptions. Passing these e-values on to hypothesis testing procedures, we yield the binary trust decisions with finite-sample error control. SCoRE avoids the need of uniform concentration, and can be readily extended to settings with distribution shifts. We evaluate the proposed methods with simulations and demonstrate their efficacy through applications to error management in drug discovery, health risk prediction, and large language models.","url_abs":"https://arxiv.org/abs/2603.24704","url_pdf":"https://arxiv.org/pdf/2603.24704","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.24704","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.24704"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Tian-Bai/SCoRE","reach":null}],"summary":{"ran_draft_wrong":1,"ran_fixture":2,"ran_violates":2,"ran_honours":3},"by_repo_kind":{"found_in_text":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"10a58657b8aff4b9","entry":"SCoRE_MDR","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"10a58657b8aff4b9"}},{"code_sha256_prefix":"50fa3afbfcc5a5bd","entry":"_as_1d_array","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"50fa3afbfcc5a5bd"}},{"code_sha256_prefix":"869896c1bd9a40dd","entry":"_as_index_array","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"869896c1bd9a40dd"}},{"code_sha256_prefix":"a9aa49627684ec7e","entry":"_get_stest","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9aa49627684ec7e"}},{"code_sha256_prefix":"53db1431e7b549a3","entry":"_is_legacy_dtest","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53db1431e7b549a3"}},{"code_sha256_prefix":"125ceb4802b0ecf1","entry":"_split_calib","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"125ceb4802b0ecf1"}},{"code_sha256_prefix":"da0356c125851100","entry":"_validate_alpha","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da0356c125851100"}},{"code_sha256_prefix":"44e69cd2f6559480","entry":"_validate_gamma","repo":"Tian-Bai/SCoRE","repo_kind":"found_in_text","path":"SCoRE/SCoRE.py","file_url":"https://github.com/Tian-Bai/SCoRE/blob/HEAD/SCoRE/SCoRE.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"44e69cd2f6559480"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}