{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-12695","title":"The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning","arxiv_id":"2608.12695","date":"2026-08-13","proceeding":null,"authors":["Ahmed Sameh","Ramzi Al-Sharawi","Yogatheesan Varatharajah"],"abstract":"Self-supervised electrocardiogram (ECG) models are often trained on a few seconds of ECG signal and, increasingly, on discretized token sequences. It remains unclear whether these choices sacrifice information needed for rhythm inference and longitudinal consistency in real-world ambulatory recordings. We present a controlled study on the Icentia11k single-lead dataset that varies (i) the input horizon (16 seconds, 1 minute, 5 minutes, and 10 minutes) and (ii) the front-end representation (continuous convolutional patch embeddings vs. fixed vector-quantized tokens), while holding the Transformer backbone and training protocol constant. Representations are assessed by downstream abnormal rhythm detection and by patient-level retrieval that probes cross-session stability. Our results show that increasing temporal context beyond 16-second snapshots yields stronger transfer and higher retrieval accuracy, with the strongest performance achieved by the 5- and 10-minute models, indicating improved capture of slow-varying rhythm dynamics and individual-specific structure. Across all evaluated horizons, continuous patch embeddings outperform discretized tokens, suggesting that quantization can discard clinically relevant waveform detail. These findings motivate ECG foundation models that emphasize extended context and continuous encoders for clinical prediction and similarity-based applications. Our code and pretrained models are publicly available at https://github.com/muha-0/ecg-ssl-representation-learning.","url_abs":"https://arxiv.org/abs/2608.12695","url_pdf":"https://arxiv.org/pdf/2608.12695","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2608.12695","atlas_url":"https://app.syntology.ai/?focus=2608.12695","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.12695"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/muha-0/ecg-ssl-representation-learning","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/muha-0/ecg-sslrepresentation-learning","reach":{"status":"gone","observed_at":"2026-09-16","how":"tree_404+repo_404"}}],"summary":{"ran":7,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"61b235ee7c0e69cc","entry":"average_precision","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/metrics.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61b235ee7c0e69cc"}},{"code_sha256_prefix":"140160542a17a7b4","entry":"compute_metrics","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/metrics.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"140160542a17a7b4"}},{"code_sha256_prefix":"1ce9ae6a8c5847ee","entry":"embed_probe_set","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/convergence.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/convergence.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ce9ae6a8c5847ee"}},{"code_sha256_prefix":"d5a48d160133173d","entry":"get_tsne_embeddings","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/t_sne.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/t_sne.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d5a48d160133173d"}},{"code_sha256_prefix":"73714c075bb607a4","entry":"info_nce","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"models/losses.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/models/losses.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"73714c075bb607a4"}},{"code_sha256_prefix":"f137c5dc0b1e879e","entry":"load_offline_codebook","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"codebooks/build_codebook.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/codebooks/build_codebook.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f137c5dc0b1e879e"}},{"code_sha256_prefix":"df1982d38efa426b","entry":"recall_at_k","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/convergence.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/convergence.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df1982d38efa426b"}},{"code_sha256_prefix":"58a4de22ca48c55a","entry":"auc_roc","repo":"muha-0/ecg-ssl-representation-learning","repo_kind":"found_in_text","path":"eval/metrics.py","file_url":"https://github.com/muha-0/ecg-ssl-representation-learning/blob/HEAD/eval/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"58a4de22ca48c55a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,885 of the 9,623 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9623,"papers_checked":6885},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}