{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-reliable-rare-category-analysis-on","title":"Towards Reliable Rare Category Analysis on Graphs via Individual Calibration","arxiv_id":"2307.09858","date":"2023-07-19","proceeding":null,"authors":["Longfeng Wu","Bowen Lei","Dongkuan Xu","Dawei Zhou"],"abstract":"Rare categories abound in a number of real-world networks and play a pivotal role in a variety of high-stakes applications, including financial fraud detection, network intrusion detection, and rare disease diagnosis. Rare category analysis (RCA) refers to the task of detecting, characterizing, and comprehending the behaviors of minority classes in a highly-imbalanced data distribution. While the vast majority of existing work on RCA has focused on improving the prediction performance, a few fundamental research questions heretofore have received little attention and are less explored: How confident or uncertain is a prediction model in rare category analysis? How can we quantify the uncertainty in the learning process and enable reliable rare category analysis? To answer these questions, we start by investigating miscalibration in existing RCA methods. Empirical results reveal that state-of-the-art RCA methods are mainly over-confident in predicting minority classes and under-confident in predicting majority classes. Motivated by the observation, we propose a novel individual calibration framework, named CALIRARE, for alleviating the unique challenges of RCA, thus enabling reliable rare category analysis. In particular, to quantify the uncertainties in RCA, we develop a node-level uncertainty quantification algorithm to model the overlapping support regions with high uncertainty; to handle the rarity of minority classes in miscalibration calculation, we generalize the distribution-based calibration metric to the instance level and propose the first individual calibration measurement on graphs named Expected Individual Calibration Error (EICE). We perform extensive experimental evaluations on real-world datasets, including rare category characterization and model calibration tasks, which demonstrate the significance of our proposed framework.","url_abs":"https://arxiv.org/abs/2307.09858v1","url_pdf":"https://arxiv.org/pdf/2307.09858v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-reliable-rare-category-analysis-on","repo_url":"https://github.com/wulongfeng/calirare","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"fraud-detection","task_name":"Fraud Detection"},{"task_slug":"intrusion-detection","task_name":"Intrusion Detection"},{"task_slug":"network-intrusion-detection","task_name":"Network Intrusion Detection"},{"task_slug":"uncertainty-quantification","task_name":"Uncertainty Quantification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.09858","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.09858"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wulongfeng/calirare","reach":{"status":"ok"}}],"summary":{"ran":9,"unverified":7},"by_repo_kind":{"official":{"samples":16,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"de3484a75de13f94","entry":"acc","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/preprocessing.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/preprocessing.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"de3484a75de13f94"}},{"code_sha256_prefix":"3237374793a55e0f","entry":"build_architecture","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/parameters.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/parameters.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3237374793a55e0f"}},{"code_sha256_prefix":"7f10ba759a5ee124","entry":"build_gcn","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/parameters.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/parameters.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7f10ba759a5ee124"}},{"code_sha256_prefix":"af00d6498d03d141","entry":"dataset_split","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/preprocessing.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/preprocessing.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"af00d6498d03d141"}},{"code_sha256_prefix":"bf8bf21c20897c02","entry":"exact_hessian","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_utils.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf8bf21c20897c02"}},{"code_sha256_prefix":"c6bac8b71ab06af2","entry":"get_numpy_parameters","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_utils.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c6bac8b71ab06af2"}},{"code_sha256_prefix":"9963b51b20d52dec","entry":"mask2set","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/preprocessing.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/preprocessing.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9963b51b20d52dec"}},{"code_sha256_prefix":"4b261e4a89d5231c","entry":"stack_torch_tensors","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_utils.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4b261e4a89d5231c"}},{"code_sha256_prefix":"b9685099d2516738","entry":"test_gcn","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/evaluate.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b9685099d2516738"}},{"code_sha256_prefix":"d9af09ac03839d4c","entry":"Deep_ensemble","repo":"wulongfeng/calirare","repo_kind":"official","path":"models/static.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/models/static.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d9af09ac03839d4c"}},{"code_sha256_prefix":"d8b2665ac26fb7fb","entry":"ace_calibration","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/evaluate.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d8b2665ac26fb7fb"}},{"code_sha256_prefix":"0a9196e066269f1b","entry":"ece_calibration","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/evaluate.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a9196e066269f1b"}},{"code_sha256_prefix":"1e24c94d80b958ec","entry":"exact_influence","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_computation.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_computation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1e24c94d80b958ec"}},{"code_sha256_prefix":"1f3c0185e000092f","entry":"get_number_parameters","repo":"wulongfeng/calirare","repo_kind":"official","path":"utils/parameters.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/utils/parameters.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1f3c0185e000092f"}},{"code_sha256_prefix":"53a5c94c8ed90e38","entry":"influence_function","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_computation.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_computation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"53a5c94c8ed90e38"}},{"code_sha256_prefix":"2dbd90e11606090d","entry":"influence_stochastic_estimation","repo":"wulongfeng/calirare","repo_kind":"official","path":"influence/influence_computation.py","file_url":"https://github.com/wulongfeng/calirare/blob/HEAD/influence/influence_computation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2dbd90e11606090d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}