{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/beyond-images-label-noise-transition-matrix","title":"Beyond Images: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features","arxiv_id":"2202.01273","date":"2022-02-02","proceeding":null,"authors":["Zhaowei Zhu","Jialu Wang","Yang Liu"],"abstract":"The label noise transition matrix, denoting the transition probabilities from clean labels to noisy labels, is crucial for designing statistically robust solutions. Existing estimators for noise transition matrices, e.g., using either anchor points or clusterability, focus on computer vision tasks that are relatively easier to obtain high-quality representations. We observe that tasks with lower-quality features fail to meet the anchor-point or clusterability condition, due to the coexistence of both uninformative and informative representations. To handle this issue, we propose a generic and practical information-theoretic approach to down-weight the less informative parts of the lower-quality features. This improvement is crucial to identifying and estimating the label noise transition matrix. The salient technical challenge is to compute the relevant information-theoretical metrics using only noisy labels instead of clean ones. We prove that the celebrated $f$-mutual information measure can often preserve the order when calculated using noisy labels. We then build our transition matrix estimator using this distilled version of features. The necessity and effectiveness of the proposed method are also demonstrated by evaluating the estimation error on a varied set of tabular data and text classification tasks with lower-quality features. Code is available at github.com/UCSC-REAL/BeyondImages.","url_abs":"https://arxiv.org/abs/2202.01273v2","url_pdf":"https://arxiv.org/pdf/2202.01273v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"beyond-images-label-noise-transition-matrix","repo_url":"https://github.com/ucsc-real/beyondimages","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"beyond-images-label-noise-transition-matrix","repo_url":"https://github.com/ucsc-real/est-t-mi","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"text-classification","task_name":"Text Classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2202.01273","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.01273"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/UCSC-REAL/BeyondImages","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ucsc-real/est-t-mi","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ucsc-real/beyondimages","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":2,"ran":3,"unverified":20},"by_repo_kind":{"official":{"samples":25,"ran":5,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d1f5c578a50e0457","entry":"cosDistance","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"run_nn.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/run_nn.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d1f5c578a50e0457"}},{"code_sha256_prefix":"1aefb5a2a8344cf3","entry":"cosDistance","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"myutils.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/myutils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1aefb5a2a8344cf3"}},{"code_sha256_prefix":"8ea81c57e23ddc38","entry":"onehot","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/utils/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ea81c57e23ddc38"}},{"code_sha256_prefix":"ef874310d3110242","entry":"onehot","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/dataloader.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef874310d3110242"}},{"code_sha256_prefix":"98948fae5be7e92e","entry":"profile","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/logger.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/logger.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"98948fae5be7e92e"}},{"code_sha256_prefix":"95864ec98b0352e1","entry":"calc_func","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"95864ec98b0352e1"}},{"code_sha256_prefix":"4ae9e39e851444d5","entry":"count_2nn_acc","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"run_nn.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/run_nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4ae9e39e851444d5"}},{"code_sha256_prefix":"3c35d31a8ca77746","entry":"count_y","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c35d31a8ca77746"}},{"code_sha256_prefix":"0b72d6d48231f171","entry":"entropy","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils_mi.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils_mi.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b72d6d48231f171"}},{"code_sha256_prefix":"7e9d232de2e93484","entry":"estimate_T_HOC_weight","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e9d232de2e93484"}},{"code_sha256_prefix":"c2f96fe6354bb1fb","entry":"extract_feature","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/hoc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2f96fe6354bb1fb"}},{"code_sha256_prefix":"bd60bff3f7c47a28","entry":"func","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bd60bff3f7c47a28"}},{"code_sha256_prefix":"a802dce412324d52","entry":"generate_noise_matrix_from_diagonal","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"myutils.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/myutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a802dce412324d52"}},{"code_sha256_prefix":"683f716ca3bcbbb1","entry":"get_T_global_min_new","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"683f716ca3bcbbb1"}},{"code_sha256_prefix":"95ed1a9915617f74","entry":"get_T_global_min_new","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/hoc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"95ed1a9915617f74"}},{"code_sha256_prefix":"568a24d3fdc2ebcb","entry":"get_T_global_min_new","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"run_nn.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/run_nn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"568a24d3fdc2ebcb"}},{"code_sha256_prefix":"a014abf3410a9ac7","entry":"make_arg_list","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/misc.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/misc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a014abf3410a9ac7"}},{"code_sha256_prefix":"df4e2a034cb6af96","entry":"make_noisy_data","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/utils/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df4e2a034cb6af96"}},{"code_sha256_prefix":"7f8fa58e6835ca57","entry":"make_noisy_data","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/dataloader.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/dataloader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f8fa58e6835ca57"}},{"code_sha256_prefix":"5eee517402b390d5","entry":"make_output_format","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/logger.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/logger.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5eee517402b390d5"}},{"code_sha256_prefix":"9cf29a68b1e2cbf5","entry":"mutual_information","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils_mi.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils_mi.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9cf29a68b1e2cbf5"}},{"code_sha256_prefix":"0f3ab4a0f758b991","entry":"mutual_information_2d_classification","repo":"ucsc-real/beyondimages","repo_kind":"official","path":"hoc.py","file_url":"https://github.com/ucsc-real/beyondimages/blob/HEAD/hoc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f3ab4a0f758b991"}},{"code_sha256_prefix":"149d5dc30e60227f","entry":"nearest_distances","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils_mi.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils_mi.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"149d5dc30e60227f"}},{"code_sha256_prefix":"7dddda47015b8708","entry":"noisify_multiclass_symmetric","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"myutils.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/myutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7dddda47015b8708"}},{"code_sha256_prefix":"88ef5a17fc986d9a","entry":"read_json","repo":"ucsc-real/est-t-mi","repo_kind":"official","path":"utils/logger.py","file_url":"https://github.com/ucsc-real/est-t-mi/blob/HEAD/utils/logger.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88ef5a17fc986d9a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}