Browse State-of-the-Art › Conformal Prediction
Conformal Prediction
277 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Conformal Prediction is a machine learning framework that provides valid measures of confidence for individual predictions. It offers a principled approach to quantify uncertainty in predictions without assuming any specific distribution for the data. This section features papers that explore various aspects of conformal prediction, including theoretical advancements, algorithmic developments, and applications across different domains.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 704 · with a code link: 277 · where Syntology ran a sample: 104 (81 with a run with no instrument failure, 23 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (104 of 704 tagged: 81 with a run with no instrument failure, 23 where every run was a failure of Syntology's instrument)
Page 1 of 8: papers 1 to 100 of 704, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
29 Sep 2020 5 repositories listed Syntology official (archive's flag): 6 ran · 26 ran (of which 1 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 0 violated, 9 with no contract checked; 13 where Syntology's instrument failed) · 37 unverified (of 63 harvested samples) · 19 pointer-only (licence)Convolutional image classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, hindering their deployment in consequential settings.
-
8 May 2019 5 repositories listedConformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions.
-
15 Jul 2021 4 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples)Conformal prediction is a user-friendly paradigm for creating statistically rigorous uncertainty sets/intervals for the predictions of such models.
-
14 Jun 2024 3 repositories listed Syntology official (archive's flag): 7 ran · 23 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 3 honoured, 2 violated, 13 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified (of 32 harvested samples) · 12 pointer-only (licence)These methods work by filtering claims from the LLM's original response if a scoring function evaluated on the claim fails to exceed a threshold calibrated via split conformal prediction.
-
10 Oct 2023 3 repositories listed Syntology official (archive's flag): 5 ran · 10 ran (of which 1 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 15 harvested samples) · 15 pointer-only (licence)Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee.
-
25 Jul 2022 3 repositories listed Syntology official (archive's flag): 10 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples)Estimating uncertainties associated with the predictions of Machine Learning (ML) models is of crucial importance to assess their robustness and predictive power.
-
25 Dec 2017 3 repositories listedWe introduce new inference procedures for counterfactual and synthetic control methods for policy evaluation.
-
12 Oct 2024 2 repositories listedConformal prediction, as an emerging uncertainty quantification technique, typically functions as post-hoc processing for the outputs of trained classifiers.
-
20 Feb 2024 2 repositories listedConformal Prediction (CP) has attracted great attention from the research community due to its strict theoretical guarantees.
-
18 Jul 2023 2 repositories listed Syntology official (archive's flag): 6 ran · 15 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 19 harvested samples)However, in many real-world scenarios, the labels Y₁,..., Yₙ are obtained by aggregating expert opinions using a voting procedure, resulting in a one-hot distribution ℙᵥₒₜₑ^(Y|X).
-
16 Jun 2023 2 repositories listed Syntology community repositories only · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)Translating this process to conformal prediction, we calibrate a stopping rule for sampling different outputs from the LM that get added to a growing set of candidates until we are confident that the output set is…
-
23 Feb 2023 2 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)However, the use of self-supervision beyond model pretraining and representation learning has been largely unexplored.
-
15 Feb 2023 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We prove that our methods achieve near-optimal strongly adaptive regret for all interval lengths simultaneously, and approximately valid coverage.
-
4 Aug 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We extend conformal prediction to control the expected value of any monotone loss function.
-
5 Jul 2022 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)In this work, we propose to explain rejects by semifactual explanations, an instance of example-based explanation methods, which them self have not been widely considered in the XAI community yet.
-
15 Jun 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex…
-
15 Feb 2022 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)While recent works tackled this issue, we argue that Adaptive Conformal Inference (ACI, Gibbs and Candès, 2021), developed for distribution-shift time series, is a good procedure for time series with general dependency.
-
10 Feb 2022 2 repositories listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 1 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 21 harvested samples) · 4 pointer-only (licence)Image-to-image regression is an important learning task, used frequently in biological imaging.
-
18 Oct 2021 2 repositories listed Syntology official (archive's flag): 17 ran · 18 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 1 honoured, 0 violated, 17 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 24 harvested samples) · 3 pointer-only (licence)However, using CP as a separate processing step after training prevents the underlying model from adapting to the prediction of confidence sets.
-
17 Mar 2021 2 repositories listedExisting survival analysis techniques heavily rely on strong modelling assumptions and are, therefore, prone to model misspecification errors.
-
18 Oct 2020 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)We develop a method to construct distribution-free prediction intervals for dynamic time-series, called \Verb|EnbPI| that wraps around any bootstrap ensemble estimator to construct sequential prediction intervals.
-
30 Jun 2025 1 repository listedThese findings provide a reliable method for verifying what LLMs "know" and how certain they are of their probabilistic internal knowledge.
-
26 Jun 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)Compared to existing RAG auto-evaluation methods, Conformal-RAG offers statistical guarantees on the quality of refined sub-claims, ensuring response reliability without the need for ground truth answers.
-
16 Jun 2025 1 repository listedIf the number of PP values smaller than WR exceeds a threshold, the suspicious model is regarded as having been trained on the protected dataset.
-
9 Jun 2025 1 repository listedAs deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount.
-
5 Jun 2025 1 repository listedWhen combined with a 1-Lipschitz robust network, we demonstrate that our lip-rcp method outperforms state-of-the-art results in both the size of the robust CP sets and computational efficiency in medium and large-scale…
-
30 May 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this work, we investigate the capabilities of CLIP models under the split conformal prediction paradigm, which provides theoretical guarantees to black-box models based on a small, labeled calibration set.
-
25 May 2025 1 repository listedWe then introduce Bernoulli prediction sets (BPS), which produce the smallest prediction sets that ensure conditional coverage in this setting.
-
22 May 2025 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 14 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 19 harvested samples)Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models.
-
22 May 2025 1 repository listedSecond, we propose latent recalibration (LR), a novel post-hoc model recalibration method that learns a transformation of the latent space with finite-sample bounds on latent calibration.
-
22 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
18 May 2025 1 repository listed
-
16 May 2025 1 repository listed
-
14 May 2025 1 repository listed
-
13 May 2025 1 repository listed
-
7 May 2025 1 repository listed
-
19 Apr 2025 1 repository listed
-
16 Apr 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
6 Apr 2025 1 repository listed
-
4 Apr 2025 1 repository listed
-
3 Apr 2025 1 repository listed
-
24 Mar 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
20 Mar 2025 1 repository listed
-
18 Mar 2025 1 repository listed
-
18 Mar 2025 1 repository listed
-
17 Mar 2025 1 repository listed
-
11 Mar 2025 1 repository listed
-
7 Mar 2025 1 repository listed
-
3 Mar 2025 1 repository listed
-
20 Feb 2025 1 repository listed
-
19 Feb 2025 1 repository listed
-
15 Feb 2025 1 repository listed
-
11 Feb 2025 1 repository listed
-
10 Feb 2025 1 repository listed
-
8 Feb 2025 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples)
-
7 Feb 2025 1 repository listed
-
5 Feb 2025 1 repository listed
-
4 Feb 2025 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
27 Jan 2025 1 repository listed
-
24 Jan 2025 1 repository listed
-
24 Jan 2025 1 repository listed
-
22 Jan 2025 1 repository listed
-
A Unified Comparative Study with Generalized Conformity Scores for Multi-Output Conformal Regression17 Jan 2025 1 repository listed
-
10 Jan 2025 1 repository listed
-
6 Jan 2025 1 repository listed
-
28 Dec 2024 1 repository listed
-
24 Dec 2024 1 repository listed
-
16 Dec 2024 1 repository listed
-
9 Dec 2024 1 repository listed
-
8 Dec 2024 1 repository listed
-
28 Nov 2024 1 repository listed
-
26 Nov 2024 1 repository listed
-
6 Nov 2024 1 repository listed
-
6 Nov 2024 1 repository listed
-
4 Nov 2024 1 repository listed
-
3 Nov 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
31 Oct 2024 1 repository listed
-
27 Oct 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
25 Oct 2024 1 repository listed
-
24 Oct 2024 1 repository listed
-
21 Oct 2024 1 repository listed
-
16 Oct 2024 1 repository listed
-
8 Oct 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
7 Oct 2024 1 repository listed
-
4 Oct 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
3 Oct 2024 1 repository listed
-
2 Oct 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
2 Oct 2024 1 repository listed
-
30 Sep 2024 1 repository listed
-
30 Sep 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
30 Sep 2024 1 repository listed
-
26 Sep 2024 1 repository listed
-
Conformal Prediction: A Theoretical Note and Benchmarking Transductive Node Classification in Graphs26 Sep 2024 1 repository listed
-
15 Sep 2024 1 repository listed
-
2 Sep 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
27 Aug 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
20 Aug 2024 1 repository listed
Syntology lines on 31 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections