Papers › Forte : Finding Outliers with Representation Typicality Estimation

Forte : Finding Outliers with Representation Typicality Estimation

2 Oct 2024arXiv:2410.01322archive 2025-07-28

Debargha Ganguly, Warren Morningstar, Andrew Yu, Vipin Chaudhary

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the training data, but ones which could be visually distinguished from the training data by human evaluation. Recent work on OOD detection has raised doubts that generative model likelihoods are optimal OOD detectors due to issues involving likelihood misestimation, entropy in the generative process, and typicality. We speculate that generative OOD detectors also failed because their models focused on the pixels rather than the semantic content of the data, leading to failures in near-OOD cases where the pixels may be similar but the information content is significantly different. We hypothesize that estimating typical sets using self-supervised learners leads to better OOD detectors. We introduce a novel approach that leverages representation learning, and informative summary statistics based on manifold estimation, to address all of the aforementioned issues. Our method outperforms other unsupervised approaches and achieves state-of-the art performance on well-established challenging benchmarks, and new synthetic data detection tasks.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

DebarghaG/forte officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Out-of-Distribution DetectionRepresentation Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Out-of-Distribution Detection CIFAR-10 vs CIFAR-100 Forte AUPR 09.69 ± 01.08 #5 of 14 Archive leaderboard report
Out-of-Distribution Detection CIFAR-10 vs CIFAR-100 Forte AUROC 97.63 ± 00.15 #5 of 14 Archive leaderboard report
Out-of-Distribution Detection CIFAR-10 vs SVHN Forte AUROC 99.84 ± 00.05 #2 of 3 Archive leaderboard report
Out-of-Distribution Detection CIFAR-10 vs SVHN Forte FPR95 00.00 ± 00.00 #2 of 3 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs NINCO Forte AUROC 98.34 ± 00.09 #1 of 5 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs NINCO Forte FPR@95 5.18 ± 00.51 #1 of 5 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs OpenImage-O Forte AUROC 96.73 ± 00.11 #3 of 7 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs OpenImage-O Forte FPR95 11.77 ± 00.57 #3 of 7 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Textures Forte AUROC 98.04 ± 00.10 #2 of 34 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Textures Forte FPR95 5.61 ± 00.25 #2 of 34 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs iNaturalist Forte AUROC 99.67 ± 00.03 #1 of 28 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs iNaturalist Forte FPR95 0.64 ± 00.06 #1 of 28 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections