{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-moral-integrity-corpus-a-benchmark-for","title":"The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems","arxiv_id":"2204.03021","date":"2022-04-06","proceeding":"ACL 2022 5","authors":["Caleb Ziems","Jane A. Yu","Yi-Chia Wang","Alon Halevy","Diyi Yang"],"abstract":"Conversational agents have come increasingly closer to human competence in open-domain dialogue settings; however, such models can reflect insensitive, hurtful, or entirely incoherent viewpoints that erode a user's trust in the moral integrity of the system. Moral deviations are difficult to mitigate because moral judgments are not universal, and there may be multiple competing judgments that apply to a situation simultaneously. In this work, we introduce a new resource, not to authoritatively resolve moral ambiguities, but instead to facilitate systematic understanding of the intuitions, values and moral judgments reflected in the utterances of dialogue systems. The Moral Integrity Corpus, MIC, is such a resource, which captures the moral assumptions of 38k prompt-reply pairs, using 99k distinct Rules of Thumb (RoTs). Each RoT reflects a particular moral conviction that can explain why a chatbot's reply may appear acceptable or problematic. We further organize RoTs with a set of 9 moral and social attributes and benchmark performance for attribute classification. Most importantly, we show that current neural language models can automatically generate new RoTs that reasonably describe previously unseen interactions, but they still struggle with certain scenarios. Our findings suggest that MIC will be a useful resource for understanding and language models' implicit moral assumptions and flexibly benchmarking the integrity of conversational agents. To download the data, see https://github.com/GT-SALT/mic","url_abs":"https://arxiv.org/abs/2204.03021v1","url_pdf":"https://arxiv.org/pdf/2204.03021v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-moral-integrity-corpus-a-benchmark-for","repo_url":"https://github.com/gt-salt/mic","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"CC-BY-SA-4.0"}},{"paper_slug":"the-moral-integrity-corpus-a-benchmark-for","repo_url":"https://github.com/salt-nlp/mic","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2204.03021","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.03021"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gt-salt/mic","reach":{"status":"ok","spdx":"CC-BY-SA-4.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/salt-nlp/mic","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/GT-SALT/mic","reach":{"status":"ok","spdx":"CC-BY-SA-4.0"}}],"summary":{"ran_draft_wrong":3,"unverified":1},"by_repo_kind":{"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"75f651decac91cb6","entry":"extract_main_response","repo":"salt-nlp/mic","repo_kind":"listed","path":"chatbot_generation/generate_answer.py","file_url":"https://github.com/salt-nlp/mic/blob/HEAD/chatbot_generation/generate_answer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"CC-BY-SA-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"75f651decac91cb6"}},{"code_sha256_prefix":"c39f5f6ee85766cf","entry":"format_str_to_savefile_name","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"c39f5f6ee85766cf"}},{"code_sha256_prefix":"3c8cb1f014309081","entry":"modify_prompt","repo":"salt-nlp/mic","repo_kind":"listed","path":"chatbot_generation/generate_answer.py","file_url":"https://github.com/salt-nlp/mic/blob/HEAD/chatbot_generation/generate_answer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"CC-BY-SA-4.0","inline_ok":false,"mcp_get_code":{"code_sha256":"3c8cb1f014309081"}},{"code_sha256_prefix":"79276e216e528e3b","entry":"final_compute_metrics","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"79276e216e528e3b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}