{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/c-melt-contrastive-enhanced-masked-auto","title":"Boosting Masked ECG-Text Auto-Encoders as Discriminative Learners","arxiv_id":"2410.02131","date":"2024-10-03","proceeding":null,"authors":["Hung Manh Pham","Aaqib Saeed","Dong Ma"],"abstract":"The accurate interpretation of Electrocardiogram (ECG) signals is pivotal for diagnosing cardiovascular diseases. Integrating ECG signals with accompanying textual reports further holds immense potential to enhance clinical diagnostics by combining physiological data and qualitative insights. However, this integration faces significant challenges due to inherent modality disparities and the scarcity of labeled data for robust cross-modal learning. To address these obstacles, we propose D-BETA, a novel framework that pre-trains ECG and text data using a contrastive masked auto-encoder architecture. D-BETA uniquely combines the strengths of generative with boosted discriminative capabilities to achieve robust cross-modal representations. This is accomplished through masked modality modeling, specialized loss functions, and an improved negative sampling strategy tailored for cross-modal alignment. Extensive experiments on five public datasets across diverse downstream tasks demonstrate that D-BETA significantly outperforms existing methods, achieving an average AUC improvement of 15% in linear probing with only one percent of training data and 2% in zero-shot performance without requiring training data over state-of-the-art models. These results highlight the effectiveness of D-BETA, underscoring its potential to advance automated clinical diagnostics through multi-modal representations. Our sample code and checkpoint are made available at https://github.com/manhph2211/D-BETA.","url_abs":"https://arxiv.org/abs/2410.02131v3","url_pdf":"https://arxiv.org/pdf/2410.02131v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"c-melt-contrastive-enhanced-masked-auto","repo_url":"https://github.com/manhph2211/d-beta","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"cross-modal-alignment","task_name":"cross-modal alignment"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.02131","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.02131"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/manhph2211/D-BETA","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/manhph2211/d-beta","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"official":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"03ea7f09e3ce6675","entry":"get_ecg_feats","repo":"manhph2211/D-BETA","repo_kind":"official","path":"models/processor.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/models/processor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"03ea7f09e3ce6675"}},{"code_sha256_prefix":"b71f1b7fa9240917","entry":"process_text","repo":"manhph2211/D-BETA","repo_kind":"official","path":"datasets/n3s.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/datasets/n3s.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b71f1b7fa9240917"}},{"code_sha256_prefix":"658a5c3878768244","entry":"neighbour_exchange","repo":"manhph2211/D-BETA","repo_kind":"official","path":"losses/ets.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/losses/ets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"658a5c3878768244"}},{"code_sha256_prefix":"99ae27cdff0183cb","entry":"neighbour_exchange_bidir","repo":"manhph2211/D-BETA","repo_kind":"official","path":"losses/ets.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/losses/ets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"99ae27cdff0183cb"}},{"code_sha256_prefix":"c0e803d6642f2812","entry":"neighbour_exchange_with_grad","repo":"manhph2211/D-BETA","repo_kind":"official","path":"losses/ets.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/losses/ets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c0e803d6642f2812"}},{"code_sha256_prefix":"0d81a17c01ba1f9a","entry":"process_file","repo":"manhph2211/D-BETA","repo_kind":"official","path":"datasets/n3s.py","file_url":"https://github.com/manhph2211/D-BETA/blob/HEAD/datasets/n3s.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"0d81a17c01ba1f9a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}