{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fvc-a-new-framework-towards-deep-video","title":"FVC: A New Framework towards Deep Video Compression in Feature Space","arxiv_id":"2105.09600","date":"2021-05-20","proceeding":"CVPR 2021 1","authors":["Zhihao Hu","Guo Lu","Dong Xu"],"abstract":"Learning based video compression attracts increasing attention in the past few years. The previous hybrid coding approaches rely on pixel space operations to reduce spatial and temporal redundancy, which may suffer from inaccurate motion estimation or less effective motion compensation. In this work, we propose a feature-space video coding network (FVC) by performing all major operations (i.e., motion estimation, motion compression, motion compensation and residual compression) in the feature space. Specifically, in the proposed deformable compensation module, we first apply motion estimation in the feature space to produce motion information (i.e., the offset maps), which will be compressed by using the auto-encoder style network. Then we perform motion compensation by using deformable convolution and generate the predicted feature. After that, we compress the residual feature between the feature from the current frame and the predicted feature from our deformable compensation module. For better frame reconstruction, the reference features from multiple previous reconstructed frames are also fused by using the non-local attention mechanism in the multi-frame feature fusion module. Comprehensive experimental results demonstrate that the proposed framework achieves the state-of-the-art performance on four benchmark datasets including HEVC, UVG, VTL and MCL-JCV.","url_abs":"https://arxiv.org/abs/2105.09600v2","url_pdf":"https://arxiv.org/pdf/2105.09600v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fvc-a-new-framework-towards-deep-video","repo_url":"https://github.com/zhihaohu/pytorchvideocompression","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"motion-compensation","task_name":"Motion Compensation"},{"task_slug":"motion-estimation","task_name":"Motion Estimation"},{"task_slug":"video-compression","task_name":"Video Compression"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"deformable-convolution","method_name":"Deformable Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2105.09600","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.09600"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhihaohu/pytorchvideocompression","reach":null}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ce3ca60159184ae7","entry":"Bitparm","repo":"zhihaohu/pytorchvideocompression","repo_kind":"official","path":"FVC/net.py","file_url":"https://github.com/zhihaohu/pytorchvideocompression/blob/HEAD/FVC/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce3ca60159184ae7"}},{"code_sha256_prefix":"d868f1b14a374d0a","entry":"ICLR17EntropyCoder","repo":"zhihaohu/pytorchvideocompression","repo_kind":"official","path":"FVC/net.py","file_url":"https://github.com/zhihaohu/pytorchvideocompression/blob/HEAD/FVC/net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d868f1b14a374d0a"}},{"code_sha256_prefix":"42163c1dd71addc8","entry":"NIPS18nocEntropyCoder","repo":"zhihaohu/pytorchvideocompression","repo_kind":"official","path":"FVC/net.py","file_url":"https://github.com/zhihaohu/pytorchvideocompression/blob/HEAD/FVC/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42163c1dd71addc8"}},{"code_sha256_prefix":"e96b231fe0b3d782","entry":"Parameter_net","repo":"zhihaohu/pytorchvideocompression","repo_kind":"official","path":"FVC/net.py","file_url":"https://github.com/zhihaohu/pytorchvideocompression/blob/HEAD/FVC/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e96b231fe0b3d782"}},{"code_sha256_prefix":"b901f12d4cea2635","entry":"VideoCompressor","repo":"zhihaohu/pytorchvideocompression","repo_kind":"official","path":"FVC/net.py","file_url":"https://github.com/zhihaohu/pytorchvideocompression/blob/HEAD/FVC/net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b901f12d4cea2635"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}