Papers › Multitask learning and benchmarking with clinical time series data

Multitask learning and benchmarking with clinical time series data

22 Mar 2017arXiv:1703.07771archive 2025-07-28

Hrayr Harutyunyan, Hrant Khachatrian, David C. Kale, Greg Ver Steeg, Aram Galstyan

Health care is one of the most exciting frontiers in data mining and machine learning. Successful adoption of electronic health records (EHRs) created an explosion in digital clinical data available for analysis, but progress in machine learning for healthcare research has been difficult to measure because of the absence of publicly available benchmark data sets. To address this problem, we propose four clinical prediction benchmarks using data derived from the publicly available Medical Information Mart for Intensive Care (MIMIC-III) database. These tasks cover a range of clinical problems including modeling risk of mortality, forecasting length of stay, detecting physiologic decline, and phenotype classification. We propose strong linear and neural baselines for all four tasks and evaluate the effect of deep supervision, multitask training and data-specific architectural modifications on the performance of neural models.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="1703.07771")

Code

Syntology Ran 4 of 40 code samples harvested from 6 repositories linked to this paper; 36 have no recorded run. Of those that ran: 4 ran · our draft was wrong.

By repository: official repository: 2 samples from 1 repository, 0 ran; community (archive-listed): 38 samples from 5 repositories, 4 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

yerevann/mimic3-benchmarks officialmentioned in papermentioned on GitHubtfMIT report
Dongximing/Mimic3 mentioned on GitHubMIT report
DoubleBlindGithub/M3 mentioned on GitHubpytorch report
atreyasha/mv-temporal-rgan mentioned on GitHub report
calvin-zcx/scehr mentioned on GitHubpytorch report
dmitrykazhdan/MEME-RNN-XAI mentioned on GitHubtf report
ericxumit/MGH_medical_AI mentioned on GitHubMIT report
jacobdeasy/flexible-ehr mentioned on GitHubpytorchNOASSERTION report
zzzace2000/mimic-preprocess mentioned on GitHubMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

40 samples harvested; 4 ran; 0 honoured the contract we drafted; 36 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

4ran · our draft was wrong
36unverified

Licence: 5 of the 40 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 6 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

assemble_episodic_data yerevann/mimic3-benchmarks/mimic3benchmark/preprocessing.py official repository unverified MIT (permissive) · 7cd0b82aa7f02d7e · report
transform_ethnicity yerevann/mimic3-benchmarks/mimic3benchmark/preprocessing.py official repository unverified MIT (permissive) · 11b229e0c37bdf09 · report
FeatureSpreadWTime DoubleBlindGithub/M3/src/models/multi_modality_model_hy.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 4cd0dbfb55fece68 · report
batched_featurespredwtime DoubleBlindGithub/M3/src/models/multi_modality_model_hy.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 9f09da060423ed56 · report
mean_text DoubleBlindGithub/M3/src/models/multi_modality_model_hy.py community (archive-listed) ran · our draft was wrong fingerprinted no licence file found · pointer only · 4229da6e72b06fdc · report
retrieve_data DoubleBlindGithub/M3/src/experiments/multitasking/multitasking.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 9cd4de4db43c8d7b · report
assemble_episodic_data zzzace2000/mimic-preprocess/mimic3benchmark/preprocessing.py community (archive-listed) unverified MIT (permissive) · e49a0870a23a4965 · report
calculate Dongximing/Mimic3/mimic3models/feature_extractor.py community (archive-listed) unverified MIT (permissive) · faa1e84a0a25b341 · report
calculate zzzace2000/mimic-preprocess/mimic3models/feature_extractor.py community (archive-listed) unverified MIT (permissive) · 53c6097a0fd76435 · report
check_decreasing Dongximing/Mimic3/mimic3models/rerun.py community (archive-listed) unverified MIT (permissive) · 92b92947091316f2 · report
convert_to_dict Dongximing/Mimic3/mimic3models/common_utils.py community (archive-listed) unverified MIT (permissive) · 75f513b01c4c892f · report
convert_to_dict zzzace2000/mimic-preprocess/mimic3models/common_utils.py community (archive-listed) unverified MIT (permissive) · 27d6da50c2df8988 · report
create_feature_indices atreyasha/mimic3_benchmarks_occlusion/occlude.py community (archive-listed) unverified MIT (permissive) · ed9fe42e6d99882d · report
dataframe_from_csv ericxumit/MGH_medical_AI/mimic3_benchmarks/util.py community (archive-listed) unverified MIT (permissive) · 8c110c6ea3423595 · report
extract_features_from_rawdata atreyasha/mimic3_benchmarks_occlusion/utils/common_utils.py community (archive-listed) unverified MIT (permissive) · bd0c4e8b10effc1f · report
extract_features_single_episode Dongximing/Mimic3/mimic3models/feature_extractor.py community (archive-listed) unverified MIT (permissive) · 8a13c19dcc3841dd · report
extract_features_single_episode zzzace2000/mimic-preprocess/mimic3models/feature_extractor.py community (archive-listed) unverified MIT (permissive) · 83643abc937d18f8 · report
get_loss Dongximing/Mimic3/mimic3models/parse_utils.py community (archive-listed) unverified MIT (permissive) · 91b4aaba848f4250 · report
get_range Dongximing/Mimic3/mimic3models/feature_extractor.py community (archive-listed) unverified MIT (permissive) · cd61a75c2a59b7a9 · report
inner_outer_occlude atreyasha/mimic3_benchmarks_occlusion/occlude.py community (archive-listed) unverified MIT (permissive) · 4cd4a2bdefe64fd0 · report
load_data atreyasha/mimic3_benchmarks_occlusion/utils/utils.py community (archive-listed) unverified MIT (permissive) · 100184c3708d67b6 · report
mean_absolute_percentage_error Dongximing/Mimic3/mimic3models/metrics.py community (archive-listed) unverified MIT (permissive) · bf861a65a6b445b6 · report
pad_sequence Dongximing/Mimic3/data_preprocess_mimic3.py community (archive-listed) unverified MIT (permissive) · d406d6988beb8d75 · report
parse_metrics Dongximing/Mimic3/mimic3models/parse_utils.py community (archive-listed) unverified MIT (permissive) · 6790b797e0e01d4b · report
parse_task Dongximing/Mimic3/mimic3models/parse_utils.py community (archive-listed) unverified MIT (permissive) · da03d8a2a12071d3 · report
print_metrics_binary Dongximing/Mimic3/mimic3models/metrics.py community (archive-listed) unverified MIT (permissive) · 601fe0024c7726b4 · report
print_metrics_multilabel Dongximing/Mimic3/mimic3models/metrics.py community (archive-listed) unverified MIT (permissive) · 32075570fb4c29e2 · report
process_partition DoubleBlindGithub/M3/mimic3benchmark/scripts/create_multitask.py community (archive-listed) unverified no licence file found · pointer only · 09ad9f0050d54667 · report
read_admissions_table ericxumit/MGH_medical_AI/mimic3_benchmarks/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · 820cfb42ff092b53 · report
read_admissions_table zzzace2000/mimic-preprocess/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · 7209ea4e70141ce9 · report
read_chunk Dongximing/Mimic3/mimic3models/common_utils.py community (archive-listed) unverified MIT (permissive) · 60a982d0773fab68 · report
read_icustays_table ericxumit/MGH_medical_AI/mimic3_benchmarks/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · 872fcd3e374ec42d · report
read_icustays_table zzzace2000/mimic-preprocess/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · d102675d5bfa26c8 · report
read_patients_table ericxumit/MGH_medical_AI/mimic3_benchmarks/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · 72b51925bb5121bb · report
read_patients_table zzzace2000/mimic-preprocess/mimic3benchmark/mimic3csv.py community (archive-listed) unverified MIT (permissive) · 137565eb07a18784 · report
softmax Dongximing/Mimic3/mimic3models/keras_utils.py community (archive-listed) unverified MIT (permissive) · 89812b9ec498264d · report
sort_and_shuffle zzzace2000/mimic-preprocess/mimic3models/common_utils.py community (archive-listed) unverified MIT (permissive) · d35aa2d84e69fad2 · report
to_map_style_dataset Dongximing/Mimic3/data_preprocess_mimic3.py community (archive-listed) unverified MIT (permissive) · 5bb34ec0ad66e78b · report
transform_ethnicity zzzace2000/mimic-preprocess/mimic3benchmark/preprocessing.py community (archive-listed) unverified MIT (permissive) · 6e8496d7c57f4090 · report
transform_gender zzzace2000/mimic-preprocess/mimic3benchmark/preprocessing.py community (archive-listed) unverified MIT (permissive) · 7d5b5a6ea641d857 · report

Tasks

BIG-bench Machine LearningBenchmarkingComputational PhenotypingGeneral ClassificationLength-of-Stay predictionMortality PredictionPhenotype classificationTime SeriesTime Series Analysis

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections