{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/trustworthy-social-bias-measurement","title":"Trustworthy Social Bias Measurement","arxiv_id":"2212.11672","date":"2022-12-20","proceeding":null,"authors":["Rishi Bommasani","Percy Liang"],"abstract":"How do we design measures of social bias that we trust? While prior work has introduced several measures, no measure has gained widespread trust: instead, mounting evidence argues we should distrust these measures. In this work, we design bias measures that warrant trust based on the cross-disciplinary theory of measurement modeling. To combat the frequently fuzzy treatment of social bias in NLP, we explicitly define social bias, grounded in principles drawn from social science research. We operationalize our definition by proposing a general bias measurement framework DivDist, which we use to instantiate 5 concrete bias measures. To validate our measures, we propose a rigorous testing protocol with 8 testing criteria (e.g. predictive validity: do measures predict biases in US employment?). Through our testing, we demonstrate considerable evidence to trust our measures, showing they overcome conceptual, technical, and empirical deficiencies present in prior measures.","url_abs":"https://arxiv.org/abs/2212.11672v1","url_pdf":"https://arxiv.org/pdf/2212.11672v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"trustworthy-social-bias-measurement","repo_url":"https://github.com/rishibommasani/biasmeasures","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2212.11672","atlas_url":"https://app.syntology.ai/?focus=2212.11672","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.11672"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rishibommasani/biasmeasures","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":10,"unverified":16},"by_repo_kind":{"official":{"samples":26,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"560faf89a34ef48f","entry":"annotate_context","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"automated_text_associations.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/automated_text_associations.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"560faf89a34ef48f"}},{"code_sha256_prefix":"014b5f4a716c09a3","entry":"automated_annotate_contexts","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"automated_text_associations.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/automated_text_associations.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"014b5f4a716c09a3"}},{"code_sha256_prefix":"b408379cad1f48fb","entry":"compute_bolukbasi_bias_direction_bolukbasi_implementation","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"aligned_estimators.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/aligned_estimators.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b408379cad1f48fb"}},{"code_sha256_prefix":"675ab641de1c844a","entry":"compute_bolukbasi_bias_direction_conventional_implementation","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"aligned_estimators.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/aligned_estimators.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"675ab641de1c844a"}},{"code_sha256_prefix":"d0c4f9fbe4b76ca9","entry":"compute_fleiss_kappa","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"interannotator.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/interannotator.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d0c4f9fbe4b76ca9"}},{"code_sha256_prefix":"4831d45f6d4a1f3b","entry":"compute_our_bias_given_SoA","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"our_estimator.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/our_estimator.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4831d45f6d4a1f3b"}},{"code_sha256_prefix":"e106ef1ddf609e33","entry":"count","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"convergent_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/convergent_validity.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e106ef1ddf609e33"}},{"code_sha256_prefix":"9517492e619039b1","entry":"get_word2positions","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"preprocess_contextualized_representations.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/preprocess_contextualized_representations.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9517492e619039b1"}},{"code_sha256_prefix":"0569862de44357f1","entry":"score","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"convergent_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/convergent_validity.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0569862de44357f1"}},{"code_sha256_prefix":"2c430c3f08f31d43","entry":"valid_targets","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"preprocess.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/preprocess.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c430c3f08f31d43"}},{"code_sha256_prefix":"a048894fe865b505","entry":"census_bias","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"predictive_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/predictive_validity.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a048894fe865b505"}},{"code_sha256_prefix":"402b394cd36844b4","entry":"compute_bolukbasi_bias","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"aligned_estimators.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/aligned_estimators.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"402b394cd36844b4"}},{"code_sha256_prefix":"158e4c4532a6ded7","entry":"compute_convergent_validity_bias_scores","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"convergent_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/convergent_validity.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"158e4c4532a6ded7"}},{"code_sha256_prefix":"3a401a1522850b9b","entry":"compute_our_bias","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"our_estimator.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/our_estimator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a401a1522850b9b"}},{"code_sha256_prefix":"240b8a07467faeeb","entry":"compute_representation_SoA","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"overamplification.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/overamplification.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"240b8a07467faeeb"}},{"code_sha256_prefix":"231638b1aca5bfa9","entry":"compute_textual_SoA","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"overamplification.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/overamplification.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"231638b1aca5bfa9"}},{"code_sha256_prefix":"ea3fb830ba5228b7","entry":"face_validity_contextualized_probing","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"face_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/face_validity.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea3fb830ba5228b7"}},{"code_sha256_prefix":"cc79fc2837c128f5","entry":"face_validity_embeddings","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"face_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/face_validity.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc79fc2837c128f5"}},{"code_sha256_prefix":"a62632cfdaeefc4d","entry":"face_validity_text","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"face_validity.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/face_validity.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a62632cfdaeefc4d"}},{"code_sha256_prefix":"a9b7261fcae23ad8","entry":"fetch_canonical_embeddings","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"preprocess_contextualized_representations.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/preprocess_contextualized_representations.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9b7261fcae23ad8"}},{"code_sha256_prefix":"5e2b2014931b0a5f","entry":"fetch_coha_word2vec_embeddings","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"data_loader.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/data_loader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e2b2014931b0a5f"}},{"code_sha256_prefix":"0572ad86b5ec780b","entry":"fetch_wikipedia","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"data_loader.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/data_loader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0572ad86b5ec780b"}},{"code_sha256_prefix":"350e094f5beee9dc","entry":"format_probing_dataset","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"preprocess_contextualized_representations.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/preprocess_contextualized_representations.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"350e094f5beee9dc"}},{"code_sha256_prefix":"1f9feae9fedcac51","entry":"make_contexts","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"preprocess.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/preprocess.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f9feae9fedcac51"}},{"code_sha256_prefix":"a5c279ab2665305b","entry":"overamplification_results","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"overamplification.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/overamplification.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5c279ab2665305b"}},{"code_sha256_prefix":"ac02062606a51812","entry":"parse_IAA_files","repo":"rishibommasani/biasmeasures","repo_kind":"official","path":"interannotator.py","file_url":"https://github.com/rishibommasani/biasmeasures/blob/HEAD/interannotator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac02062606a51812"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}