{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/aces-automatic-cohort-extraction-system-for","title":"ACES: Automatic Cohort Extraction System for Event-Stream Datasets","arxiv_id":"2406.19653","date":"2024-06-28","proceeding":null,"authors":["Justin Xu","Jack Gallifant","Alistair E. W. Johnson","Matthew B. A. McDermott"],"abstract":"Reproducibility remains a significant challenge in machine learning (ML) for healthcare. Datasets, model pipelines, and even task/cohort definitions are often private in this field, leading to a significant barrier in sharing, iterating, and understanding ML results on electronic health record (EHR) datasets. This paper addresses a significant part of this problem by introducing the Automatic Cohort Extraction System (ACES) for event-stream data. This library is designed to simultaneously simplify the development of task/cohorts for ML in healthcare and also enable the reproduction of these cohorts, both at an exact level for single datasets and at a conceptual level across datasets. To accomplish this, ACES provides (1) a highly intuitive and expressive configuration language for defining both dataset-specific concepts and dataset-agnostic inclusion/exclusion criteria, and (2) a pipeline to automatically extract patient records that meet these defined criteria from real-world data. ACES can be automatically applied to any dataset in either the Medical Event Data Standard (MEDS) or EventStreamGPT (ESGPT) formats, or to any dataset in which the necessary task-specific predicates can be extracted in an event-stream form. ACES has the potential to significantly lower the barrier to entry for defining ML tasks that learn representations, redefine the way researchers interact with EHR datasets, and significantly improve the state of reproducibility for ML studies in this modality. ACES is available at https://github.com/justin13601/aces. A short video demonstration of ACES is available at https://youtu.be/i_hCaHDydqA.","url_abs":"https://arxiv.org/abs/2406.19653v2","url_pdf":"https://arxiv.org/pdf/2406.19653v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"aces-automatic-cohort-extraction-system-for","repo_url":"https://github.com/justin13601/aces","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":null,"method_name":"Library"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.19653","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.19653"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/justin13601/aces","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/mmcdermott/MEDS-DEV","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":4,"unverified":2},"by_repo_kind":{"official":{"samples":4,"ran":2,"repositories":1},"found_in_text":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"df8467ccc389cd56","entry":"check_constraints","repo":"justin13601/aces","repo_kind":"official","path":"src/aces/constraints.py","file_url":"https://github.com/justin13601/aces/blob/HEAD/src/aces/constraints.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df8467ccc389cd56"}},{"code_sha256_prefix":"d838fc305079ad94","entry":"check_static_variables","repo":"justin13601/aces","repo_kind":"official","path":"src/aces/constraints.py","file_url":"https://github.com/justin13601/aces/blob/HEAD/src/aces/constraints.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d838fc305079ad94"}},{"code_sha256_prefix":"5872fbfff6fc19fb","entry":"get_pretrain_model_dir","repo":"mmcdermott/MEDS-DEV","repo_kind":"found_in_text","path":"src/MEDS_DEV/models/cehrbert/pretrain_cehrbert.py","file_url":"https://github.com/mmcdermott/MEDS-DEV/blob/HEAD/src/MEDS_DEV/models/cehrbert/pretrain_cehrbert.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5872fbfff6fc19fb"}},{"code_sha256_prefix":"79831c6f501148e5","entry":"get_venv_bin_path","repo":"mmcdermott/MEDS-DEV","repo_kind":"found_in_text","path":"src/MEDS_DEV/utils.py","file_url":"https://github.com/mmcdermott/MEDS-DEV/blob/HEAD/src/MEDS_DEV/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"79831c6f501148e5"}},{"code_sha256_prefix":"e906489bf0f0f6fe","entry":"direct_load_plain_predicates","repo":"justin13601/aces","repo_kind":"official","path":"src/aces/predicates.py","file_url":"https://github.com/justin13601/aces/blob/HEAD/src/aces/predicates.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e906489bf0f0f6fe"}},{"code_sha256_prefix":"afdc4e12db0ea0a3","entry":"process_esgpt_data","repo":"justin13601/aces","repo_kind":"official","path":"src/aces/predicates.py","file_url":"https://github.com/justin13601/aces/blob/HEAD/src/aces/predicates.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"afdc4e12db0ea0a3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}