{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ddxplus-a-new-dataset-for-medical-automatic","title":"DDXPlus: A New Dataset For Automatic Medical Diagnosis","arxiv_id":"2205.09148","date":"2022-05-18","proceeding":null,"authors":["Arsene Fansi Tchango","Rishab Goel","Zhi Wen","Julien Martel","Joumana Ghosn"],"abstract":"There has been a rapidly growing interest in Automatic Symptom Detection (ASD) and Automatic Diagnosis (AD) systems in the machine learning research literature, aiming to assist doctors in telemedicine services. These systems are designed to interact with patients, collect evidence about their symptoms and relevant antecedents, and possibly make predictions about the underlying diseases. Doctors would review the interactions, including the evidence and the predictions, collect if necessary additional information from patients, before deciding on next steps. Despite recent progress in this area, an important piece of doctors' interactions with patients is missing in the design of these systems, namely the differential diagnosis. Its absence is largely due to the lack of datasets that include such information for models to train on. In this work, we present a large-scale synthetic dataset of roughly 1.3 million patients that includes a differential diagnosis, along with the ground truth pathology, symptoms and antecedents for each patient. Unlike existing datasets which only contain binary symptoms and antecedents, this dataset also contains categorical and multi-choice symptoms and antecedents useful for efficient data collection. Moreover, some symptoms are organized in a hierarchy, making it possible to design systems able to interact with patients in a logical way. As a proof-of-concept, we extend two existing AD and ASD systems to incorporate the differential diagnosis, and provide empirical evidence that using differentials as training signals is essential for the efficiency of such systems or for helping doctors better understand the reasoning of those systems.","url_abs":"https://arxiv.org/abs/2205.09148v3","url_pdf":"https://arxiv.org/pdf/2205.09148v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ddxplus-a-new-dataset-for-medical-automatic","repo_url":"https://github.com/bruzwen/ddxplus","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"ddxplus-a-new-dataset-for-medical-automatic","repo_url":"https://github.com/mila-iqia/ddxplus","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"medical-diagnosis","task_name":"Medical Diagnosis"}],"methods":[],"datasets_introduced":[{"slug":"ddxplus","name":"DDXPlus","full_name":"DDXPlus: A New Dataset For Automatic Medical Diagnosis"}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2205.09148","atlas_url":"https://app.syntology.ai/?focus=2205.09148","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.09148"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mila-iqia/ddxplus","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bruzwen/ddxplus","reach":{"status":"ok"}}],"summary":{"ran_fixture":2,"ran_draft_wrong":1},"by_repo_kind":{"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"80605a2c3fde7691","entry":"dist_accuracy","repo":"mila-iqia/ddxplus","repo_kind":"listed","path":"code/basd/asd.py","file_url":"https://github.com/mila-iqia/ddxplus/blob/HEAD/code/basd/asd.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"80605a2c3fde7691"}},{"code_sha256_prefix":"e1fea567b0c380c0","entry":"softXEnt","repo":"mila-iqia/ddxplus","repo_kind":"listed","path":"code/basd/asd.py","file_url":"https://github.com/mila-iqia/ddxplus/blob/HEAD/code/basd/asd.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e1fea567b0c380c0"}},{"code_sha256_prefix":"4e67d80a6128cc3d","entry":"soft_cross_entropy","repo":"mila-iqia/ddxplus","repo_kind":"listed","path":"code/aarlc/ddxplus_code/agent.py","file_url":"https://github.com/mila-iqia/ddxplus/blob/HEAD/code/aarlc/ddxplus_code/agent.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4e67d80a6128cc3d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}