{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2512-01428","title":"Masked Symbol Modeling for Demodulation of Oversampled Baseband Communication Signals in Impulsive Noise-Dominated Channels","arxiv_id":"2512.01428","date":"2025-12-01","proceeding":"NeurIPS","authors":["Oguz Bedir","Nurullah Sevim","Mostafa Ibrahim","Sabit Ekin"],"abstract":"Recent breakthroughs in natural language processing show that attention mechanism in Transformer networks, trained via masked-token prediction, enables models to capture the semantic context of the tokens and internalize the grammar of language. While the application of Transformers to communication systems is a burgeoning field, the notion of context within physical waveforms remains under-explored. This paper addresses that gap by re-examining inter-symbol contribution (ISC) caused by pulse-shaping overlap. Rather than treating ISC as a nuisance, we view it as a deterministic source of contextual information embedded in oversampled complex baseband signals. We propose Masked Symbol Modeling (MSM), a framework for the physical (PHY) layer inspired by Bidirectional Encoder Representations from Transformers methodology. In MSM, a subset of symbol aligned samples is randomly masked, and a Transformer predicts the missing symbol identifiers using the surrounding \"in-between\" samples. Through this objective, the model learns the latent syntax of complex baseband waveforms. We illustrate MSM's potential by applying it to the task of demodulating signals corrupted by impulsive noise, where the model infers corrupted segments by leveraging the learned context. Our results suggest a path toward receivers that interpret, rather than merely detect communication signals, opening new avenues for context-aware PHY layer design.","url_abs":"https://arxiv.org/abs/2512.01428","url_pdf":"https://arxiv.org/pdf/2512.01428","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2512.01428","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2512.01428"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/OguzBedir/Masked_Symbol_Modeling","reach":{"status":"ok"}}],"summary":{"unverified":10},"by_repo_kind":{"found_in_text":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"817ed75b1676ca5e","entry":"add_awgn_vec","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/infer_imp.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/infer_imp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"817ed75b1676ca5e"}},{"code_sha256_prefix":"4cf59a45bd8f5213","entry":"add_middleton_a_vec","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/infer_imp.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/infer_imp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4cf59a45bd8f5213"}},{"code_sha256_prefix":"f847af280cc41e11","entry":"collate_fn","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/train_utils.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/train_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f847af280cc41e11"}},{"code_sha256_prefix":"cd561e1dd77e1297","entry":"create_run_dirs","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/train_utils.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/train_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cd561e1dd77e1297"}},{"code_sha256_prefix":"74d8fb94bc27e6a3","entry":"find_runs_by_pattern","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"plot_metrics.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/plot_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"74d8fb94bc27e6a3"}},{"code_sha256_prefix":"265e36f5ea10846f","entry":"load_cfg","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"plot_metrics.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/plot_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"265e36f5ea10846f"}},{"code_sha256_prefix":"183f947b5ddae1d5","entry":"load_metrics","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"plot_metrics.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/plot_metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"183f947b5ddae1d5"}},{"code_sha256_prefix":"f0a10d1d7e80b793","entry":"pool_all_symbol_embeddings","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/infer_utils.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/infer_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0a10d1d7e80b793"}},{"code_sha256_prefix":"20022f72be4c793b","entry":"resolve_checkpoint","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/infer_utils.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/infer_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"20022f72be4c793b"}},{"code_sha256_prefix":"cdc6afbb64a20f40","entry":"train_step","repo":"OguzBedir/Masked_Symbol_Modeling","repo_kind":"found_in_text","path":"core/engine.py","file_url":"https://github.com/OguzBedir/Masked_Symbol_Modeling/blob/HEAD/core/engine.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cdc6afbb64a20f40"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"eess.SP","source":"arxiv_api"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}