Papers › Multi-class probabilistic classification using inductive and cross Venn-Abers predictors

Multi-class probabilistic classification using inductive and cross Venn-Abers predictors

16 Jun 2017Proceedings of the Sixth Workshop on Conformal and Probabilistic Prediction and Applications, PMLR 60:1-2 2017 6archive 2025-07-28

Valery Manokhin

Inductive (IVAP) and cross (CVAP) Venn–Abers predictors are computationally efficient algorithms for probabilistic prediction in binary classification problems. We present a new approach to multi-class probability estimation by turning IVAPs and CVAPs into multi-class probabilistic predictors. The proposed multi-class predictors are experimentally more accurate than both uncalibrated predictors and existing calibration methods. Unlike other methods such as Platt's scaler and Isotonic Regression Venn-ABERS predictors (being a form of conformal prediction) contain inbuilt mathematical guarantees of validity (lack of bias). In addition Venn-ABERS predictors are multi-output predictors that output two probability predictions of class 1. Such two probability prediction of assigning label 1 for each test objectc can be considered prediction interval. The interval width contains valuable information about degree of certainty of prediction, such information is not available when using other calibration methods such as Platt's and isotonic regression.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Binary ClassificationClassificationClassifier calibrationConformal PredictionPrediction

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections