{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/clustering-with-confidence-finding-clusters","title":"Clustering with Confidence: Finding Clusters with Statistical Guarantees","arxiv_id":"1612.08714","date":"2016-12-27","proceeding":null,"authors":["Andreas Henelius","Kai Puolamäki","Henrik Boström","Panagiotis Papapetrou"],"abstract":"Clustering is a widely used unsupervised learning method for finding\nstructure in the data. However, the resulting clusters are typically presented\nwithout any guarantees on their robustness; slightly changing the used data\nsample or re-running a clustering algorithm involving some stochastic component\nmay lead to completely different clusters. There is, hence, a need for\ntechniques that can quantify the instability of the generated clusters. In this\nstudy, we propose a technique for quantifying the instability of a clustering\nsolution and for finding robust clusters, termed core clusters, which\ncorrespond to clusters where the co-occurrence probability of each data item\nwithin a cluster is at least $1 - \\alpha$. We demonstrate how solving the core\nclustering problem is linked to finding the largest maximal cliques in a graph.\nWe show that the method can be used with both clustering and classification\nalgorithms. The proposed method is tested on both simulated and real datasets.\nThe results show that the obtained clusters indeed meet the guarantees on\nrobustness.","url_abs":"http://arxiv.org/abs/1612.08714v2","url_pdf":"http://arxiv.org/pdf/1612.08714v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"clustering-with-confidence-finding-clusters","repo_url":"https://github.com/bwrc/corecluster-r","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}