{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/robustness-disparities-in-face-detection","title":"Robustness Disparities in Face Detection","arxiv_id":"2211.15937","date":"2022-11-29","proceeding":null,"authors":["Samuel Dooley","George Z. Wei","Tom Goldstein","John P. Dickerson"],"abstract":"Facial analysis systems have been deployed by large companies and critiqued by scholars and activists for the past decade. Many existing algorithmic audits examine the performance of these systems on later stage elements of facial analysis systems like facial recognition and age, emotion, or perceived gender prediction; however, a core component to these systems has been vastly understudied from a fairness perspective: face detection, sometimes called face localization. Since face detection is a pre-requisite step in facial analysis systems, the bias we observe in face detection will flow downstream to the other components like facial recognition and emotion prediction. Additionally, no prior work has focused on the robustness of these systems under various perturbations and corruptions, which leaves open the question of how various people are impacted by these phenomena. We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models. We use both standard and recently released academic facial datasets to quantitatively analyze trends in face detection robustness. Across all the datasets and systems, we generally find that photos of individuals who are $\\textit{masculine presenting}$, $\\textit{older}$, of $\\textit{darker skin type}$, or have $\\textit{dim lighting}$ are more susceptible to errors than their counterparts in other identities.","url_abs":"https://arxiv.org/abs/2211.15937v1","url_pdf":"https://arxiv.org/pdf/2211.15937v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"robustness-disparities-in-face-detection","repo_url":"https://github.com/dooleys/robustness-disparities-in-commercial-face-detection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"robustness-disparities-in-face-detection","repo_url":"https://github.com/dooleys/robustness","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}}],"tasks":[{"task_slug":"face-detection","task_name":"Face Detection"},{"task_slug":"fairness","task_name":"Fairness"},{"task_slug":"gender-prediction","task_name":"Gender Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2211.15937","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.15937"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dooleys/robustness-disparities-in-commercial-face-detection","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dooleys/robustness","reach":{"status":"ok","spdx":"GPL-3.0"}}],"summary":{"ran":1,"unverified":4},"by_repo_kind":{"official":{"samples":5,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"bc8b7f1d3348c560","entry":"disk","repo":"dooleys/Robustness-Disparities-in-Commercial-Face-Detection","repo_kind":"official","path":"code/imagenet_c_big/corruptions.py","file_url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection/blob/HEAD/code/imagenet_c_big/corruptions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bc8b7f1d3348c560"}},{"code_sha256_prefix":"3fe212e00cbe6fb3","entry":"plasma_fractal","repo":"dooleys/Robustness-Disparities-in-Commercial-Face-Detection","repo_kind":"official","path":"code/imagenet_c_big/corruptions.py","file_url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection/blob/HEAD/code/imagenet_c_big/corruptions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3fe212e00cbe6fb3"}},{"code_sha256_prefix":"b761a77387ca9f01","entry":"plasma_fractal_large","repo":"dooleys/Robustness-Disparities-in-Commercial-Face-Detection","repo_kind":"official","path":"code/imagenet_c_big/corruptions.py","file_url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection/blob/HEAD/code/imagenet_c_big/corruptions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b761a77387ca9f01"}},{"code_sha256_prefix":"769533906d4fba4e","entry":"upload_file","repo":"dooleys/Robustness-Disparities-in-Commercial-Face-Detection","repo_kind":"official","path":"code/detect_faces.py","file_url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection/blob/HEAD/code/detect_faces.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"769533906d4fba4e"}},{"code_sha256_prefix":"4906d5a1ac05b118","entry":"write_upload_response","repo":"dooleys/Robustness-Disparities-in-Commercial-Face-Detection","repo_kind":"official","path":"code/detect_faces.py","file_url":"https://github.com/dooleys/Robustness-Disparities-in-Commercial-Face-Detection/blob/HEAD/code/detect_faces.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4906d5a1ac05b118"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}