{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/low-latency-space-time-supersampling-for-real","title":"Low-latency Space-time Supersampling for Real-time Rendering","arxiv_id":"2312.10890","date":"2023-12-18","proceeding":null,"authors":["Ruian He","Shili Zhou","Yuqi Sun","Ri Cheng","Weimin Tan","Bo Yan"],"abstract":"With the rise of real-time rendering and the evolution of display devices, there is a growing demand for post-processing methods that offer high-resolution content in a high frame rate. Existing techniques often suffer from quality and latency issues due to the disjointed treatment of frame supersampling and extrapolation. In this paper, we recognize the shared context and mechanisms between frame supersampling and extrapolation, and present a novel framework, Space-time Supersampling (STSS). By integrating them into a unified framework, STSS can improve the overall quality with lower latency. To implement an efficient architecture, we treat the aliasing and warping holes unified as reshading regions and put forth two key components to compensate the regions, namely Random Reshading Masking (RRM) and Efficient Reshading Module (ERM). Extensive experiments demonstrate that our approach achieves superior visual fidelity compared to state-of-the-art (SOTA) methods. Notably, the performance is achieved within only 4ms, saving up to 75\\% of time against the conventional two-stage pipeline that necessitates 17ms.","url_abs":"https://arxiv.org/abs/2312.10890v1","url_pdf":"https://arxiv.org/pdf/2312.10890v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"low-latency-space-time-supersampling-for-real","repo_url":"https://github.com/ryanhe312/STSSNet-AAAI2024","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2312.10890","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.10890"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ryanhe312/STSSNet-AAAI2024","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":7,"unverified":2},"by_repo_kind":{"official":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"034ed8891e3681dc","entry":"ReadData","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"dataloaders.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"034ed8891e3681dc"}},{"code_sha256_prefix":"5dcb4148be3fcbaf","entry":"accuracy","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/metrics.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5dcb4148be3fcbaf"}},{"code_sha256_prefix":"20e51012f2735158","entry":"calc_metrics_y","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/matlab_metric.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/matlab_metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"20e51012f2735158"}},{"code_sha256_prefix":"4dccd0b32f2a3bb4","entry":"crop","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"dataloaders.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4dccd0b32f2a3bb4"}},{"code_sha256_prefix":"950a7e63666ebcd1","entry":"mse","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"950a7e63666ebcd1"}},{"code_sha256_prefix":"2b1245dfa8d76fe2","entry":"rgb2ycbcr","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/matlab_metric.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/matlab_metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b1245dfa8d76fe2"}},{"code_sha256_prefix":"61cc9667c37ecd27","entry":"top_k_acc","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/metrics.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61cc9667c37ecd27"}},{"code_sha256_prefix":"aa273a27e3ac59d7","entry":"calc_metrics","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"utils/matlab_metric.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/utils/matlab_metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa273a27e3ac59d7"}},{"code_sha256_prefix":"2e6dfb7f0e708e29","entry":"form_input","repo":"ryanhe312/STSSNet-AAAI2024","repo_kind":"official","path":"dataloaders.py","file_url":"https://github.com/ryanhe312/STSSNet-AAAI2024/blob/HEAD/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e6dfb7f0e708e29"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}