{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/evaluation-measures-for-hierarchical","title":"Evaluation Measures for Hierarchical Classification: a unified view and novel approaches","arxiv_id":"1306.6802","date":"2013-06-28","proceeding":null,"authors":["Aris Kosmopoulos","Ioannis Partalas","Eric Gaussier","Georgios Paliouras","Ion Androutsopoulos"],"abstract":"Hierarchical classification addresses the problem of classifying items into a\nhierarchy of classes. An important issue in hierarchical classification is the\nevaluation of different classification algorithms, which is complicated by the\nhierarchical relations among the classes. Several evaluation measures have been\nproposed for hierarchical classification using the hierarchy in different ways.\nThis paper studies the problem of evaluation in hierarchical classification by\nanalyzing and abstracting the key components of the existing performance\nmeasures. It also proposes two alternative generic views of hierarchical\nevaluation and introduces two corresponding novel measures. The proposed\nmeasures, along with the state-of-the art ones, are empirically tested on three\nlarge datasets from the domain of text classification. The empirical results\nillustrate the undesirable behavior of existing approaches and how the proposed\nmethods overcome most of these methods across a range of cases.","url_abs":"http://arxiv.org/abs/1306.6802v2","url_pdf":"http://arxiv.org/pdf/1306.6802v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"evaluation-measures-for-hierarchical","repo_url":"https://github.com/fbenites/sklearn-hierarchical-classification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"evaluation-measures-for-hierarchical","repo_url":"https://github.com/globality-corp/sklearn-hierarchical-classification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"text-classification","task_name":"Text Classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1306.6802","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1306.6802"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fbenites/sklearn-hierarchical-classification","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/globality-corp/sklearn-hierarchical-classification","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":17},"by_repo_kind":{"listed":{"samples":17,"ran":0,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a7a7ed3dfc53de37","entry":"apply_along_rows","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/array.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/array.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a7a7ed3dfc53de37"}},{"code_sha256_prefix":"c438ab5681bb1630","entry":"apply_along_rows","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/array.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/array.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c438ab5681bb1630"}},{"code_sha256_prefix":"5978231e213ac4cb","entry":"apply_rollup_Xy","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/array.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/array.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5978231e213ac4cb"}},{"code_sha256_prefix":"74355edadce3939c","entry":"apply_rollup_Xy","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/array.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/array.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"74355edadce3939c"}},{"code_sha256_prefix":"9a75ea148d2f9d75","entry":"fill_ancestors","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/metrics.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9a75ea148d2f9d75"}},{"code_sha256_prefix":"471aa6e2394887ce","entry":"fill_ancestors","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/metrics.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"471aa6e2394887ce"}},{"code_sha256_prefix":"46c4baefb00ca6da","entry":"flatten_list","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/array.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/array.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"46c4baefb00ca6da"}},{"code_sha256_prefix":"a3540498c7bff102","entry":"h_precision_score","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/metrics.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a3540498c7bff102"}},{"code_sha256_prefix":"ef0794922f8e6a63","entry":"h_recall_score","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/metrics.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/metrics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ef0794922f8e6a63"}},{"code_sha256_prefix":"f6577bee67e69780","entry":"is_estimator","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/validation.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/validation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f6577bee67e69780"}},{"code_sha256_prefix":"24fe396d1811877a","entry":"logger","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/decorators.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/decorators.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"24fe396d1811877a"}},{"code_sha256_prefix":"61994a011b1cf8d5","entry":"logger","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/decorators.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/decorators.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"61994a011b1cf8d5"}},{"code_sha256_prefix":"db6c3509919eb91c","entry":"make_flat_hierarchy","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/graph.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/graph.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"db6c3509919eb91c"}},{"code_sha256_prefix":"469dd58aeafd18fc","entry":"make_flat_hierarchy","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/graph.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/graph.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"469dd58aeafd18fc"}},{"code_sha256_prefix":"422ba2af0df6008e","entry":"rollup_nodes","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/graph.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/graph.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"422ba2af0df6008e"}},{"code_sha256_prefix":"fda4b7a4196ed395","entry":"rollup_nodes","repo":"globality-corp/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/graph.py","file_url":"https://github.com/globality-corp/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/graph.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fda4b7a4196ed395"}},{"code_sha256_prefix":"976ef00f1dedd5f4","entry":"root_nodes","repo":"fbenites/sklearn-hierarchical-classification","repo_kind":"listed","path":"sklearn_hierarchical_classification/graph.py","file_url":"https://github.com/fbenites/sklearn-hierarchical-classification/blob/HEAD/sklearn_hierarchical_classification/graph.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"976ef00f1dedd5f4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}