{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deep-common-feature-mining-for-efficient","title":"Deep Common Feature Mining for Efficient Video Semantic Segmentation","arxiv_id":"2403.02689","date":"2024-03-05","proceeding":null,"authors":["Yaoyan Zheng","Hongyu Yang","Di Huang"],"abstract":"Recent advancements in video semantic segmentation have made substantial progress by exploiting temporal correlations. Nevertheless, persistent challenges, including redundant computation and the reliability of the feature propagation process, underscore the need for further innovation. In response, we present Deep Common Feature Mining (DCFM), a novel approach strategically designed to address these challenges by leveraging the concept of feature sharing. DCFM explicitly decomposes features into two complementary components. The common representation extracted from a key-frame furnishes essential high-level information to neighboring non-key frames, allowing for direct re-utilization without feature propagation. Simultaneously, the independent feature, derived from each video frame, captures rapidly changing information, providing frame-specific clues crucial for segmentation. To achieve such decomposition, we employ a symmetric training strategy tailored for sparsely annotated data, empowering the backbone to learn a robust high-level representation enriched with common information. Additionally, we incorporate a self-supervised loss function to reinforce intra-class feature similarity and enhance temporal consistency. Experimental evaluations on the VSPW and Cityscapes datasets demonstrate the effectiveness of our method, showing a superior balance between accuracy and efficiency. The implementation is available at https://github.com/BUAAHugeGun/DCFM.","url_abs":"https://arxiv.org/abs/2403.02689v2","url_pdf":"https://arxiv.org/pdf/2403.02689v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-common-feature-mining-for-efficient","repo_url":"https://github.com/buaahugegun/dcfm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"video-semantic-segmentation","task_name":"Video Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.02689","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.02689"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/buaahugegun/dcfm","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"8ad3d3eec93ed6ee","entry":"Upsample","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/dcfm/basic.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/dcfm/basic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ad3d3eec93ed6ee"}},{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/hrnet/seg_hrnet.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/hrnet/seg_hrnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"913db018c110c536","entry":"get_dataset","repo":"buaahugegun/dcfm","repo_kind":"official","path":"datasets/cityscapes.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/datasets/cityscapes.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"913db018c110c536"}},{"code_sha256_prefix":"acd703ad768b199d","entry":"make_seg_head","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/dcfm/basic.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/dcfm/basic.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"acd703ad768b199d"}},{"code_sha256_prefix":"fd61955b3982528e","entry":"make_seg_head","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/dcfm/decoder.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/dcfm/decoder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fd61955b3982528e"}},{"code_sha256_prefix":"4815333a2b49f3f1","entry":"resnet18","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/pspnet/resnet.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/pspnet/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4815333a2b49f3f1"}},{"code_sha256_prefix":"81e6f33194021bdd","entry":"resnet34","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/pspnet/resnet.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/pspnet/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"81e6f33194021bdd"}},{"code_sha256_prefix":"10c47a89aaf107b7","entry":"get_dataset","repo":"buaahugegun/dcfm","repo_kind":"official","path":"datasets/camvid.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/datasets/camvid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"10c47a89aaf107b7"}},{"code_sha256_prefix":"bf289ce14602f49c","entry":"get_dataset","repo":"buaahugegun/dcfm","repo_kind":"official","path":"datasets/vspw.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/datasets/vspw.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf289ce14602f49c"}},{"code_sha256_prefix":"045014c5ced09078","entry":"get_seg_model","repo":"buaahugegun/dcfm","repo_kind":"official","path":"nets/hrnet/seg_hrnet.py","file_url":"https://github.com/buaahugegun/dcfm/blob/HEAD/nets/hrnet/seg_hrnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"045014c5ced09078"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}