{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/model-cards-for-model-reporting","title":"Model Cards for Model Reporting","arxiv_id":"1810.03993","date":"2018-10-05","proceeding":null,"authors":["Margaret Mitchell","Simone Wu","Andrew Zaldivar","Parker Barnes","Lucy Vasserman","Ben Hutchinson","Elena Spitzer","Inioluwa Deborah Raji","Timnit Gebru"],"abstract":"Trained machine learning models are increasingly used to perform high-impact\ntasks in areas such as law enforcement, medicine, education, and employment. In\norder to clarify the intended use cases of machine learning models and minimize\ntheir usage in contexts for which they are not well suited, we recommend that\nreleased models be accompanied by documentation detailing their performance\ncharacteristics. In this paper, we propose a framework that we call model\ncards, to encourage such transparent model reporting. Model cards are short\ndocuments accompanying trained machine learning models that provide benchmarked\nevaluation in a variety of conditions, such as across different cultural,\ndemographic, or phenotypic groups (e.g., race, geographic location, sex,\nFitzpatrick skin type) and intersectional groups (e.g., age and race, or sex\nand Fitzpatrick skin type) that are relevant to the intended application\ndomains. Model cards also disclose the context in which models are intended to\nbe used, details of the performance evaluation procedures, and other relevant\ninformation. While we focus primarily on human-centered machine learning models\nin the application fields of computer vision and natural language processing,\nthis framework can be used to document any trained machine learning model. To\nsolidify the concept, we provide cards for two supervised models: One trained\nto detect smiling faces in images, and one trained to detect toxic comments in\ntext. We propose model cards as a step towards the responsible democratization\nof machine learning and related AI technology, increasing transparency into how\nwell AI technology works. We hope this work encourages those releasing trained\nmachine learning models to accompany model releases with similar detailed\nevaluation numbers and other relevant documentation.","url_abs":"http://arxiv.org/abs/1810.03993v2","url_pdf":"http://arxiv.org/pdf/1810.03993v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/SachaIZADI/Misc-Machine-Learning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/ai-hci/ai-hci.github.io","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/cgpotts/dynasent","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/cylynx/verifyml-reports","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/harvard-edge/ml-sensors","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/jacopotagliabue/dag-card-is-the-new-model-card","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/lamalab-org/eval-cards","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/model-card/model-card","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/pair-code/datacardsplaybook","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/rewardreports/reward-reports","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/salesforce/codet5","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"model-cards-for-model-reporting","repo_url":"https://github.com/tensorflow/model-card-toolkit","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"machine-learning","task_name":"BIG-bench Machine Learning"},{"task_slug":"model","task_name":"model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1810.03993","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1810.03993"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/harvard-edge/ml-sensors","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cylynx/verifyml-reports","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jacopotagliabue/dag-card-is-the-new-model-card","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pair-code/datacardsplaybook","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/salesforce/codet5","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tensorflow/model-card-toolkit","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/model-card/model-card","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lamalab-org/eval-cards","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cgpotts/dynasent","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SachaIZADI/Misc-Machine-Learning","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ai-hci/ai-hci.github.io","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rewardreports/reward-reports","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":8},"by_repo_kind":{"listed":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"1de5cb6d09d27896","entry":"find_user_from_tags","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"1de5cb6d09d27896"}},{"code_sha256_prefix":"6fd22617425986fe","entry":"draw_histogram","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/graphics.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/graphics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6fd22617425986fe"}},{"code_sha256_prefix":"3ce49971c95d39c5","entry":"figure_to_base64str","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/graphics.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/graphics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3ce49971c95d39c5"}},{"code_sha256_prefix":"7798a46fb3bac215","entry":"parse_proto_file","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/io_utils.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/io_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7798a46fb3bac215"}},{"code_sha256_prefix":"71f79125049402a3","entry":"read_file","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/io_utils.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/io_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"71f79125049402a3"}},{"code_sha256_prefix":"ae38f009caac15cc","entry":"stringify_slice_key","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/graphics.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/graphics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ae38f009caac15cc"}},{"code_sha256_prefix":"5f6caf0bd0169cd8","entry":"suffix","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/io_utils.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/io_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5f6caf0bd0169cd8"}},{"code_sha256_prefix":"201268fcbea40035","entry":"update","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/json_utils.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/json_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"201268fcbea40035"}},{"code_sha256_prefix":"df404bd1b3f804d3","entry":"validate_json_schema","repo":"tensorflow/model-card-toolkit","repo_kind":"listed","path":"model_card_toolkit/utils/json_utils.py","file_url":"https://github.com/tensorflow/model-card-toolkit/blob/HEAD/model_card_toolkit/utils/json_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"df404bd1b3f804d3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}