{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/when-fair-classification-meets-noisy","title":"When Fair Classification Meets Noisy Protected Attributes","arxiv_id":"2307.03306","date":"2023-07-06","proceeding":null,"authors":["Avijit Ghosh","Pablo Kvitca","Christo Wilson"],"abstract":"The operationalization of algorithmic fairness comes with several practical challenges, not the least of which is the availability or reliability of protected attributes in datasets. In real-world contexts, practical and legal impediments may prevent the collection and use of demographic data, making it difficult to ensure algorithmic fairness. While initial fairness algorithms did not consider these limitations, recent proposals aim to achieve algorithmic fairness in classification by incorporating noisiness in protected attributes or not using protected attributes at all. To the best of our knowledge, this is the first head-to-head study of fair classification algorithms to compare attribute-reliant, noise-tolerant and attribute-blind algorithms along the dual axes of predictivity and fairness. We evaluated these algorithms via case studies on four real-world datasets and synthetic perturbations. Our study reveals that attribute-blind and noise-tolerant fair classifiers can potentially achieve similar level of performance as attribute-reliant algorithms, even when protected attributes are noisy. However, implementing them in practice requires careful nuance. Our study provides insights into the practical implications of using fair classification algorithms in scenarios where protected attributes are noisy or partially available.","url_abs":"https://arxiv.org/abs/2307.03306v2","url_pdf":"https://arxiv.org/pdf/2307.03306v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"when-fair-classification-meets-noisy","repo_url":"https://github.com/evijit/awareness_vs_unawareness","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"fairness","task_name":"Fairness"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.03306","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.03306"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/evijit/awareness_vs_unawareness","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_draft_wrong":3,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"95a5102403956adb","entry":"check_filename","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"arl/hyperparameter.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/arl/hyperparameter.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"95a5102403956adb"}},{"code_sha256_prefix":"0267157a4a1ac6e6","entry":"chi_square_value","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"dro/robust_losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/dro/robust_losses.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0267157a4a1ac6e6"}},{"code_sha256_prefix":"afeec1fcc48eedf3","entry":"concave_hinge_loss","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"softweights_mdro/losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/softweights_mdro/losses.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"afeec1fcc48eedf3"}},{"code_sha256_prefix":"2b8de0efd0313a25","entry":"cvar_value","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"dro/robust_losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/dro/robust_losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2b8de0efd0313a25"}},{"code_sha256_prefix":"9235d41fc9cad6b1","entry":"default_preprocessing","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"dro/LSACDataset.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/dro/LSACDataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9235d41fc9cad6b1"}},{"code_sha256_prefix":"ad7dd9787d3e8805","entry":"fenchel_kl_cvar","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"dro/robust_losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/dro/robust_losses.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ad7dd9787d3e8805"}},{"code_sha256_prefix":"0b9548efc547248c","entry":"get_optimal_parameters","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"arl/argparser.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/arl/argparser.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b9548efc547248c"}},{"code_sha256_prefix":"76fcf7a513586b4f","entry":"ramp_loss","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"softweights_mdro/losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/softweights_mdro/losses.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"76fcf7a513586b4f"}},{"code_sha256_prefix":"18ab23a5582df7e2","entry":"ramp_loss_lb","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"softweights_mdro/losses.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/softweights_mdro/losses.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"18ab23a5582df7e2"}},{"code_sha256_prefix":"644ac6bce810b422","entry":"get_dataset_stats","repo":"evijit/awareness_vs_unawareness","repo_kind":"official","path":"arl/dataloader.py","file_url":"https://github.com/evijit/awareness_vs_unawareness/blob/HEAD/arl/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"644ac6bce810b422"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}