{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-12432","title":"SkeFi: Cross-Modal Knowledge Transfer for Wireless Skeleton-Based Action Recognition","arxiv_id":"2601.12432","date":"2026-01-18","proceeding":null,"authors":["Shunyu Huang","Yunjiao Zhou","Jianfei Yang"],"abstract":"Skeleton-based action recognition leverages human pose keypoints to categorize human actions, which shows superior generalization and interoperability compared to regular end-to-end action recognition. Existing solutions use RGB cameras to annotate skeletal keypoints, but their performance declines in dark environments and raises privacy concerns, limiting their use in smart homes and hospitals. This paper explores non-invasive wireless sensors, i.e., LiDAR and mmWave, to mitigate these challenges as a feasible alternative. Two problems are addressed: (1) insufficient data on wireless sensor modality to train an accurate skeleton estimation model, and (2) skeletal keypoints derived from wireless sensors are noisier than RGB, causing great difficulties for subsequent action recognition models. Our work, SkeFi, overcomes these gaps through a novel cross-modal knowledge transfer method acquired from the data-rich RGB modality. We propose the enhanced Temporal Correlation Adaptive Graph Convolution (TC-AGC) with frame interactive enhancement to overcome the noise from missing or inconsecutive frames. Additionally, our research underscores the effectiveness of enhancing multiscale temporal modeling through dual temporal convolution. By integrating TC-AGC with temporal modeling for cross-modal transfer, our framework can extract accurate poses and actions from noisy wireless sensors. Experiments demonstrate that SkeFi realizes state-of-the-art performances on mmWave and LiDAR. The code is available at https://github.com/Huang0035/Skefi.","url_abs":"https://arxiv.org/abs/2601.12432","url_pdf":"https://arxiv.org/pdf/2601.12432","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2601.12432","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.12432"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Huang0035/Skefi","reach":null}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":8,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"ef052095fdfc57f5","entry":"MultiScale_TemporalConv","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef052095fdfc57f5"}},{"code_sha256_prefix":"6bf32346ae40a7d2","entry":"TemporalConv","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6bf32346ae40a7d2"}},{"code_sha256_prefix":"ffed4f85d50832c9","entry":"import_class","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"ffed4f85d50832c9"}},{"code_sha256_prefix":"a7f6340f84183fb4","entry":"unit_gcn","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a7f6340f84183fb4"}},{"code_sha256_prefix":"29582835e80c1d70","entry":"unit_tcn","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"29582835e80c1d70"}},{"code_sha256_prefix":"e7cf371ff7c23405","entry":"Model","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e7cf371ff7c23405"}},{"code_sha256_prefix":"7ea30bb79d77909b","entry":"TCN_GCN_unit","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7ea30bb79d77909b"}},{"code_sha256_prefix":"ac6409a06ff2da4c","entry":"conv_branch_init","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ac6409a06ff2da4c"}},{"code_sha256_prefix":"f1917c3011636f99","entry":"weights_init","repo":"Huang0035/Skefi","repo_kind":"found_in_text","path":"model/TCAGC_ESP.py","file_url":"https://github.com/Huang0035/Skefi/blob/HEAD/model/TCAGC_ESP.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f1917c3011636f99"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}