{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learned-image-compression-with-discretized","title":"Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modules","arxiv_id":"2001.01568","date":"2020-01-06","proceeding":null,"authors":["Zhengxue Cheng","Heming Sun","Masaru Takeuchi","Jiro Katto"],"abstract":"Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there is still a performance gap between learned compression algorithms and reigning compression standards, especially in terms of widely used PSNR metric. In this paper, we explore the remaining redundancy of recent learned compression algorithms. We have found accurate entropy models for rate estimation largely affect the optimization of network parameters and thus affect the rate-distortion performance. Therefore, in this paper, we propose to use discretized Gaussian Mixture Likelihoods to parameterize the distributions of latent codes, which can achieve a more accurate and flexible entropy model. Besides, we take advantage of recent attention modules and incorporate them into network architecture to enhance the performance. Experimental results demonstrate our proposed method achieves a state-of-the-art performance compared to existing learned compression methods on both Kodak and high-resolution datasets. To our knowledge our approach is the first work to achieve comparable performance with latest compression standard Versatile Video Coding (VVC) regarding PSNR. More importantly, our approach generates more visually pleasant results when optimized by MS-SSIM. This project page is at this https URL https://github.com/ZhengxueCheng/Learned-Image-Compression-with-GMM-and-Attention","url_abs":"https://arxiv.org/abs/2001.01568v3","url_pdf":"https://arxiv.org/pdf/2001.01568v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learned-image-compression-with-discretized","repo_url":"https://github.com/ZhengxueCheng/Learned-Image-Compression-with-GMM-and-Attention","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"learned-image-compression-with-discretized","repo_url":"https://github.com/fengyurenpingsheng/Learned-image-compression-with-GLLMM","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"learned-image-compression-with-discretized","repo_url":"https://github.com/orange-opensource/cool-chic","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"learned-image-compression-with-discretized","repo_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-compression","task_name":"Image Compression"},{"task_slug":"ms-ssim","task_name":"MS-SSIM"},{"task_slug":"ssim","task_name":"SSIM"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2001.01568","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.01568"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fengyurenpingsheng/Learned-image-compression-with-GLLMM","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ZhengxueCheng/Learned-Image-Compression-with-GMM-and-Attention","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/orange-opensource/cool-chic","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":14},"by_repo_kind":{"listed":{"samples":14,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c9947c33e3a54f62","entry":"CalcuPSNR","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/basics.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/basics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9947c33e3a54f62"}},{"code_sha256_prefix":"a5a05f863cc1b904","entry":"MultiScaleSSIM","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"metric.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/metric.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a5a05f863cc1b904"}},{"code_sha256_prefix":"c9b7f182fa1af125","entry":"feature_probs_based_More_Gauss","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"model.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9b7f182fa1af125"}},{"code_sha256_prefix":"9e2bc979c478d250","entry":"feature_probs_based_sigma","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"model.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9e2bc979c478d250"}},{"code_sha256_prefix":"569f86999a28550f","entry":"gaussian_filter","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/ms_ssim_torch.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/ms_ssim_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"569f86999a28550f"}},{"code_sha256_prefix":"330dd4378c3e3a35","entry":"get_loader","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"datasets.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"330dd4378c3e3a35"}},{"code_sha256_prefix":"4e3ec336e202299e","entry":"get_train_loader","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"datasets.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/datasets.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4e3ec336e202299e"}},{"code_sha256_prefix":"67b83d1f47e01c3f","entry":"load_model","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"model.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"67b83d1f47e01c3f"}},{"code_sha256_prefix":"7ea107a5705e6f95","entry":"ms_ssim","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/ms_ssim_torch.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/ms_ssim_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7ea107a5705e6f95"}},{"code_sha256_prefix":"c46a2076f53009e8","entry":"msssim","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"metric.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/metric.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c46a2076f53009e8"}},{"code_sha256_prefix":"94c8354fe1b4c307","entry":"psnr","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"metric.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/metric.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"94c8354fe1b4c307"}},{"code_sha256_prefix":"ba24f201a717509b","entry":"relu","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/basics.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/basics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba24f201a717509b"}},{"code_sha256_prefix":"d9e269e86cc2b394","entry":"ssim","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/ms_ssim_torch.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/ms_ssim_torch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d9e269e86cc2b394"}},{"code_sha256_prefix":"2784ebaef09c1269","entry":"yuv_import_444","repo":"LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention","repo_kind":"listed","path":"models/basics.py","file_url":"https://github.com/LiuLei95/PyTorch-Learned-Image-Compression-with-GMM-and-Attention/blob/HEAD/models/basics.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2784ebaef09c1269"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}