{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/nlpositionality-characterizing-design-biases","title":"NLPositionality: Characterizing Design Biases of Datasets and Models","arxiv_id":"2306.01943","date":"2023-06-02","proceeding":null,"authors":["Sebastin Santy","Jenny T. Liang","Ronan Le Bras","Katharina Reinecke","Maarten Sap"],"abstract":"Design biases in NLP systems, such as performance differences for different populations, often stem from their creator's positionality, i.e., views and lived experiences shaped by identity and background. Despite the prevalence and risks of design biases, they are hard to quantify because researcher, system, and dataset positionality is often unobserved. We introduce NLPositionality, a framework for characterizing design biases and quantifying the positionality of NLP datasets and models. Our framework continuously collects annotations from a diverse pool of volunteer participants on LabintheWild, and statistically quantifies alignment with dataset labels and model predictions. We apply NLPositionality to existing datasets and models for two tasks -- social acceptability and hate speech detection. To date, we have collected 16,299 annotations in over a year for 600 instances from 1,096 annotators across 87 countries. We find that datasets and models align predominantly with Western, White, college-educated, and younger populations. Additionally, certain groups, such as non-binary people and non-native English speakers, are further marginalized by datasets and models as they rank least in alignment across all tasks. Finally, we draw from prior literature to discuss how researchers can examine their own positionality and that of their datasets and models, opening the door for more inclusive NLP systems.","url_abs":"https://arxiv.org/abs/2306.01943v1","url_pdf":"https://arxiv.org/pdf/2306.01943v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nlpositionality-characterizing-design-biases","repo_url":"https://github.com/liang-jenny/nlpositionality","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"hate-speech-detection","task_name":"Hate Speech Detection"}],"methods":[{"method_slug":"align","method_name":"ALIGN"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2306.01943","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.01943"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/liang-jenny/nlpositionality","reach":null}],"summary":{"ran_draft_wrong":10,"unverified":2},"by_repo_kind":{"official":{"samples":12,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":12,"samples":[{"code_sha256_prefix":"0329331880ee3f88","entry":"__filter_country_sphere__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0329331880ee3f88"}},{"code_sha256_prefix":"8d26601c26011c43","entry":"__filter_language_english__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8d26601c26011c43"}},{"code_sha256_prefix":"91abaa033e0c22c8","entry":"__mean_df__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"91abaa033e0c22c8"}},{"code_sha256_prefix":"bc05eaf371b298aa","entry":"__process_age__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bc05eaf371b298aa"}},{"code_sha256_prefix":"7c1b7acdb297a937","entry":"__process_country__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c1b7acdb297a937"}},{"code_sha256_prefix":"b52a7acf5c948381","entry":"__process_education__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b52a7acf5c948381"}},{"code_sha256_prefix":"7c4744d1a8e7f4d0","entry":"__process_ethnicities__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c4744d1a8e7f4d0"}},{"code_sha256_prefix":"bc8786a1a325761e","entry":"__process_gender__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bc8786a1a325761e"}},{"code_sha256_prefix":"649c2e26246448ba","entry":"__process_language__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"649c2e26246448ba"}},{"code_sha256_prefix":"98411b21c8575adf","entry":"__process_religion__","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"98411b21c8575adf"}},{"code_sha256_prefix":"5bd75c0ba4e74041","entry":"get_pearson_rs","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5bd75c0ba4e74041"}},{"code_sha256_prefix":"a0e901a56136f213","entry":"process_litw_data","repo":"liang-jenny/nlpositionality","repo_kind":"official","path":"nlpositionality.py","file_url":"https://github.com/liang-jenny/nlpositionality/blob/HEAD/nlpositionality.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a0e901a56136f213"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}