{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-24903","title":"The Geometry of Saturation: Effective Rank Predicts When Labels Stop Helping in Few-Shot Classification","arxiv_id":"2606.24903","date":"2026-06-12","proceeding":null,"authors":["Arnav Gupta"],"abstract":"Few-shot label acquisition lacks a label-free signal for when additional labels cease to improve accuracy: existing stopping criteria either require a held-out validation set (violating the few-shot premise) or rely on theoretically ungrounded heuristics, so we introduce the spectral saturation index $S(K)=\\mathrm{erank}(\\hatΣ_W^{(K)})/K$, the exponential spectral entropy of the pooled within-class covariance normalized by per-class support size $K$, which measures the exploration rate per label and falls below a fixed threshold $τ=0.02$ once the explored spectral subspace saturates and marginal accuracy gains vanish; across 49 real tasks (binary, 5-way, 10-way) and three frozen backbones (PCA-50, CLIP ViT-B/32, DINOv2 ViT-S/14), $S(K)$ correlates strongly with the marginal gain on doubling the support set ($ρ_{\\text{pool}}=0.6366$, $p=2.9\\times10^{-57}$, cluster-bootstrap 95\\% CI $[0.551,0.720]$), a fixed $τ=0.02$ classifies stop/continue decisions with cluster-bootstrap $\\mathrm{AUC}=0.787$ (95\\% CI $[0.713,0.860]$) with high recall on meaningful gains ($ΔA>1\\%$), and a partial correlation controlling for $\\log K$ yields $ρ_{\\text{partial}}=0.324$ ($p=1.65\\times10^{-13}$), confirming $S(K)$ carries spectral information beyond shared $K$-dependence; theory predicts this from first principles, since the population effective rank sets the saturation scale $K_{\\text{sat}}\\approx\\mathrm{erank}(Σ_W)/τ$, $τ=0.02$ sits at the boundary between the first and second descent (Nakkiran et al., 2021), and $O(1/K)$ bias in the sample effective rank explains the small-$K$ hump in $S(K)$; for unregularized linear probes ($C=\\infty$), practitioners should halt when $S(K)<0.02$ (PCA-50, hard stop) or monitor $S(K)$ dropping from $\\sim0.3\\to0.05$ (foundation models, diminishing-returns signal), with computation costing $\\sim1$ ms at $d=50$.","url_abs":"https://arxiv.org/abs/2606.24903","url_pdf":"https://arxiv.org/pdf/2606.24903","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.24903","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.24903"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/MrArnav69/spectral-saturation","reach":null}],"summary":{"ran_honours":1},"by_repo_kind":{"found_in_text":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"904c3388a701ff72","entry":"saturation_index","repo":"MrArnav69/spectral-saturation","repo_kind":"found_in_text","path":"spectral_saturation/core/geometry.py","file_url":"https://github.com/MrArnav69/spectral-saturation/blob/HEAD/spectral_saturation/core/geometry.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"904c3388a701ff72"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}