{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/identifying-label-errors-in-object-detection","title":"Identifying Label Errors in Object Detection Datasets by Loss Inspection","arxiv_id":"2303.06999","date":"2023-03-13","proceeding":null,"authors":["Marius Schubert","Tobias Riedlinger","Karsten Kahl","Daniel Kröll","Sebastian Schoenen","Siniša Šegvić","Matthias Rottmann"],"abstract":"Labeling datasets for supervised object detection is a dull and time-consuming task. Errors can be easily introduced during annotation and overlooked during review, yielding inaccurate benchmarks and performance degradation of deep neural networks trained on noisy labels. In this work, we for the first time introduce a benchmark for label error detection methods on object detection datasets as well as a label error detection method and a number of baselines. We simulate four different types of randomly introduced label errors on train and test sets of well-labeled object detection datasets. For our label error detection method we assume a two-stage object detector to be given and consider the sum of both stages' classification and regression losses. The losses are computed with respect to the predictions and the noisy labels including simulated label errors, aiming at detecting the latter. We compare our method to three baselines: a naive one without deep learning, the object detector's score and the entropy of the classification softmax distribution. We outperform all baselines and demonstrate that among the considered methods, ours is the only one that detects label errors of all four types efficiently. Furthermore, we detect real label errors a) on commonly used test datasets in object detection and b) on a proprietary dataset. In both cases we achieve low false positives rates, i.e., we detect label errors with a precision for a) of up to 71.5% and for b) with 97%.","url_abs":"https://arxiv.org/abs/2303.06999v3","url_pdf":"https://arxiv.org/pdf/2303.06999v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"identifying-label-errors-in-object-detection","repo_url":"https://github.com/mschubert95/identifying_label_errors_in_od","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"label-error-detection","task_name":"Label Error Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.06999","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.06999"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mschubert95/identifying_label_errors_in_od","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"unverified":2},"by_repo_kind":{"official":{"samples":4,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cc1d87b0a0678212","entry":"anchor_inside_flags","repo":"mschubert95/identifying_label_errors_in_od","repo_kind":"official","path":"label_error_detection/mmdet/core/anchor/utils.py","file_url":"https://github.com/mschubert95/identifying_label_errors_in_od/blob/HEAD/label_error_detection/mmdet/core/anchor/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc1d87b0a0678212"}},{"code_sha256_prefix":"0910773f52297bf8","entry":"images_to_levels","repo":"mschubert95/identifying_label_errors_in_od","repo_kind":"official","path":"label_error_detection/mmdet/core/anchor/utils.py","file_url":"https://github.com/mschubert95/identifying_label_errors_in_od/blob/HEAD/label_error_detection/mmdet/core/anchor/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0910773f52297bf8"}},{"code_sha256_prefix":"4befdb30b7583175","entry":"calc_region","repo":"mschubert95/identifying_label_errors_in_od","repo_kind":"official","path":"label_error_detection/mmdet/core/anchor/utils.py","file_url":"https://github.com/mschubert95/identifying_label_errors_in_od/blob/HEAD/label_error_detection/mmdet/core/anchor/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4befdb30b7583175"}},{"code_sha256_prefix":"9b65c7ad38f844ad","entry":"iou2d","repo":"mschubert95/identifying_label_errors_in_od","repo_kind":"official","path":"transformation/simulate_label_errors.py","file_url":"https://github.com/mschubert95/identifying_label_errors_in_od/blob/HEAD/transformation/simulate_label_errors.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9b65c7ad38f844ad"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}