{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/controlled-analyses-of-social-biases-in","title":"Controlled Analyses of Social Biases in Wikipedia Bios","arxiv_id":"2101.00078","date":"2020-12-31","proceeding":null,"authors":["Anjalie Field","Chan Young Park","Kevin Z. Lin","Yulia Tsvetkov"],"abstract":"Social biases on Wikipedia, a widely-read global platform, could greatly influence public opinion. While prior research has examined man/woman gender bias in biography articles, possible influences of other demographic attributes limit conclusions. In this work, we present a methodology for analyzing Wikipedia pages about people that isolates dimensions of interest (e.g., gender), from other attributes (e.g., occupation). Given a target corpus for analysis (e.g.~biographies about women), we present a method for constructing a comparison corpus that matches the target corpus in as many attributes as possible, except the target one. We develop evaluation metrics to measure how well the comparison corpus aligns with the target corpus and then examine how articles about gender and racial minorities (cis. women, non-binary people, transgender women, and transgender men; African American, Asian American, and Hispanic/Latinx American people) differ from other articles. In addition to identifying suspect social biases, our results show that failing to control for covariates can result in different conclusions and veil biases. Our contributions include methodology that facilitates further analyses of bias in Wikipedia articles, findings that can aid Wikipedia editors in reducing biases, and a framework and evaluation metrics to guide future work in this area.","url_abs":"https://arxiv.org/abs/2101.00078v4","url_pdf":"https://arxiv.org/pdf/2101.00078v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"controlled-analyses-of-social-biases-in","repo_url":"https://github.com/anjalief/wikipedia_bias_public","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"articles","task_name":"Articles"}],"methods":[{"method_slug":null,"method_name":"American"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2101.00078","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2101.00078"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/anjalief/wikipedia_bias_public","reach":null}],"summary":{"ran_draft_wrong":5},"by_repo_kind":{"official":{"samples":5,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"d1ba2bc6c063af82","entry":"get_category","repo":"anjalief/wikipedia_bias_public","repo_kind":"official","path":"category_analysis.py","file_url":"https://github.com/anjalief/wikipedia_bias_public/blob/HEAD/category_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d1ba2bc6c063af82"}},{"code_sha256_prefix":"ef444081c77e6e69","entry":"get_cosine_sim","repo":"anjalief/wikipedia_bias_public","repo_kind":"official","path":"tfidf_matching.py","file_url":"https://github.com/anjalief/wikipedia_bias_public/blob/HEAD/tfidf_matching.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef444081c77e6e69"}},{"code_sha256_prefix":"0e82a83de03287de","entry":"get_num_cats","repo":"anjalief/wikipedia_bias_public","repo_kind":"official","path":"tfidf_matching.py","file_url":"https://github.com/anjalief/wikipedia_bias_public/blob/HEAD/tfidf_matching.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0e82a83de03287de"}},{"code_sha256_prefix":"d9332d0e49896a87","entry":"get_people","repo":"anjalief/wikipedia_bias_public","repo_kind":"official","path":"category_analysis.py","file_url":"https://github.com/anjalief/wikipedia_bias_public/blob/HEAD/category_analysis.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d9332d0e49896a87"}},{"code_sha256_prefix":"fd6d0fdb98eb4dc9","entry":"get_pivot_cosine_sim","repo":"anjalief/wikipedia_bias_public","repo_kind":"official","path":"tfidf_matching.py","file_url":"https://github.com/anjalief/wikipedia_bias_public/blob/HEAD/tfidf_matching.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fd6d0fdb98eb4dc9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}