{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/how-much-is-unseen-depends-chiefly-on","title":"How Much is Unseen Depends Chiefly on Information About the Seen","arxiv_id":"2402.05835","date":"2024-02-08","proceeding":null,"authors":["Seongmin Lee","Marcel Böhme"],"abstract":"The missing mass refers to the proportion of data points in an unknown population of classifier inputs that belong to classes not present in the classifier's training data, which is assumed to be a random sample from that unknown population. We find that in expectation the missing mass is entirely determined by the number $f_k$ of classes that do appear in the training data the same number of times and an exponentially decaying error. While this is the first precise characterization of the expected missing mass in terms of the sample, the induced estimator suffers from an impractically high variance. However, our theory suggests a large search space of nearly unbiased estimators that can be searched effectively and efficiently. Hence, we cast distribution-free estimation as an optimization problem to find a distribution-specific estimator with a minimized mean-squared error (MSE), given only the sample. In our experiments, our search algorithm discovers estimators that have a substantially smaller MSE than the state-of-the-art Good-Turing estimator. This holds for over 93% of runs when there are at least as many samples as classes. Our estimators' MSE is roughly 80% of the Good-Turing estimator's.","url_abs":"https://arxiv.org/abs/2402.05835v2","url_pdf":"https://arxiv.org/pdf/2402.05835v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"how-much-is-unseen-depends-chiefly-on","repo_url":"https://github.com/nimgnoeseel/unseenga","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.05835","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.05835"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/niMgnoeSeeL/UnseenGA","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nimgnoeseel/unseenga","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"ran_honours":1},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c7cc68f130f06681","entry":"change_n","repo":"nimgnoeseel/unseenga","repo_kind":"official","path":"larger-sample-assessment.py","file_url":"https://github.com/nimgnoeseel/unseenga/blob/HEAD/larger-sample-assessment.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7cc68f130f06681"}},{"code_sha256_prefix":"40e11d1aa8bc1071","entry":"compute_formula","repo":"nimgnoeseel/unseenga","repo_kind":"official","path":"larger-sample-assessment.py","file_url":"https://github.com/nimgnoeseel/unseenga/blob/HEAD/larger-sample-assessment.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"40e11d1aa8bc1071"}},{"code_sha256_prefix":"7e6f02ded2fec45d","entry":"get_p","repo":"niMgnoeSeeL/UnseenGA","repo_kind":"official","path":"ga.py","file_url":"https://github.com/niMgnoeSeeL/UnseenGA/blob/HEAD/ga.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e6f02ded2fec45d"}},{"code_sha256_prefix":"a98126e459685c80","entry":"minimal_cov_compute","repo":"nimgnoeseel/unseenga","repo_kind":"official","path":"helpf1var.py","file_url":"https://github.com/nimgnoeseel/unseenga/blob/HEAD/helpf1var.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a98126e459685c80"}},{"code_sha256_prefix":"922cae65b39cc291","entry":"minimal_cov_vs_mass_compute","repo":"nimgnoeseel/unseenga","repo_kind":"official","path":"helpf1var.py","file_url":"https://github.com/nimgnoeseel/unseenga/blob/HEAD/helpf1var.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"922cae65b39cc291"}},{"code_sha256_prefix":"4e7615d22b314d11","entry":"minimal_var_compute","repo":"nimgnoeseel/unseenga","repo_kind":"official","path":"helpf1var.py","file_url":"https://github.com/nimgnoeseel/unseenga/blob/HEAD/helpf1var.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e7615d22b314d11"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}