{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/null-it-out-guarding-protected-attributes-by","title":"Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection","arxiv_id":"2004.07667","date":"2020-04-16","proceeding":"ACL 2020 6","authors":["Shauli Ravfogel","Yanai Elazar","Hila Gonen","Michael Twiton","Yoav Goldberg"],"abstract":"The ability to control for the kinds of information encoded in neural representation has a variety of use cases, especially in light of the challenge of interpreting these models. We present Iterative Null-space Projection (INLP), a novel method for removing information from neural representations. Our method is based on repeated training of linear classifiers that predict a certain property we aim to remove, followed by projection of the representations on their null-space. By doing so, the classifiers become oblivious to that target property, making it hard to linearly separate the data according to it. While applicable for multiple uses, we evaluate our method on bias and fairness use-cases, and show that our method is able to mitigate bias in word embeddings, as well as to increase fairness in a setting of multi-class classification.","url_abs":"https://arxiv.org/abs/2004.07667v2","url_pdf":"https://arxiv.org/pdf/2004.07667v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"null-it-out-guarding-protected-attributes-by","repo_url":"https://github.com/Shaul1321/nullspace_projection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"null-it-out-guarding-protected-attributes-by","repo_url":"https://github.com/jasonshaoshun/amsal","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"fairness","task_name":"Fairness"},{"task_slug":"multi-class-classification","task_name":"Multi-class Classification"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.07667","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.07667"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jasonshaoshun/amsal","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Shaul1321/nullspace_projection","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":2},"by_repo_kind":{"listed":{"samples":2,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ce67444253b9014e","entry":"_apply_nullspace_projection","repo":"jasonshaoshun/amsal","repo_kind":"listed","path":"src/bias-bench/bias_bench/debias/inlp/context_nullspace_projection.py","file_url":"https://github.com/jasonshaoshun/amsal/blob/HEAD/src/bias-bench/bias_bench/debias/inlp/context_nullspace_projection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce67444253b9014e"}},{"code_sha256_prefix":"cb7fbb7396d48f07","entry":"compute_projection_matrix","repo":"jasonshaoshun/amsal","repo_kind":"listed","path":"src/bias-bench/bias_bench/debias/inlp/context_nullspace_projection.py","file_url":"https://github.com/jasonshaoshun/amsal/blob/HEAD/src/bias-bench/bias_bench/debias/inlp/context_nullspace_projection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cb7fbb7396d48f07"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}