{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/2s-odis-two-stage-omni-directional-image","title":"2S-ODIS: Two-Stage Omni-Directional Image Synthesis by Geometric Distortion Correction","arxiv_id":"2409.09969","date":"2024-09-16","proceeding":null,"authors":["Atsuya Nakata","Takao Yamanaka"],"abstract":"Omni-directional images have been increasingly used in various applications, including virtual reality and SNS (Social Networking Services). However, their availability is comparatively limited in contrast to normal field of view (NFoV) images, since specialized cameras are required to take omni-directional images. Consequently, several methods have been proposed based on generative adversarial networks (GAN) to synthesize omni-directional images, but these approaches have shown difficulties in training of the models, due to instability and/or significant time consumption in the training. To address these problems, this paper proposes a novel omni-directional image synthesis method, 2S-ODIS (Two-Stage Omni-Directional Image Synthesis), which generated high-quality omni-directional images but drastically reduced the training time. This was realized by utilizing the VQGAN (Vector Quantized GAN) model pre-trained on a large-scale NFoV image database such as ImageNet without fine-tuning. Since this pre-trained model does not represent distortions of omni-directional images in the equi-rectangular projection (ERP), it cannot be applied directly to the omni-directional image synthesis in ERP. Therefore, two-stage structure was adopted to first create a global coarse image in ERP and then refine the image by integrating multiple local NFoV images in the higher resolution to compensate the distortions in ERP, both of which are based on the pre-trained VQGAN model. As a result, the proposed method, 2S-ODIS, achieved the reduction of the training time from 14 days in OmniDreamer to four days in higher image quality.","url_abs":"https://arxiv.org/abs/2409.09969v1","url_pdf":"https://arxiv.org/pdf/2409.09969v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"2s-odis-two-stage-omni-directional-image","repo_url":"https://github.com/islab-sophia/2s-odis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"erp","task_name":"ERP"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"distortion-correction","task_name":"distortion correction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2409.09969","atlas_url":"https://app.syntology.ai/?focus=2409.09969","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.09969"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/islab-sophia/2s-odis","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":5},"by_repo_kind":{"official":{"samples":8,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d468ea2e3f4342ca","entry":"circle_padding","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"models/first_stage_module.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/models/first_stage_module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d468ea2e3f4342ca"}},{"code_sha256_prefix":"1930316bc03b7009","entry":"get_model_construction_settings","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"models/second_stage_module.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/models/second_stage_module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1930316bc03b7009"}},{"code_sha256_prefix":"221b2d116fdf1032","entry":"get_obj_from_str","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"vqgan_recompile.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/vqgan_recompile.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"221b2d116fdf1032"}},{"code_sha256_prefix":"4f9cc680da5dd3aa","entry":"calc_is","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"eval/evaluation.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/eval/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4f9cc680da5dd3aa"}},{"code_sha256_prefix":"d9e5c7d5273d1565","entry":"calc_lpips","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"eval/evaluation.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/eval/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d9e5c7d5273d1565"}},{"code_sha256_prefix":"701c72f1e9bd9f01","entry":"decode_images","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"image_generation.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/image_generation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"701c72f1e9bd9f01"}},{"code_sha256_prefix":"f0ac78b4e05be194","entry":"instantiate_from_config","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"vqgan_recompile.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/vqgan_recompile.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f0ac78b4e05be194"}},{"code_sha256_prefix":"1d03f85136b2c811","entry":"load_model_from_config","repo":"islab-sophia/2s-odis","repo_kind":"official","path":"vqgan_recompile.py","file_url":"https://github.com/islab-sophia/2s-odis/blob/HEAD/vqgan_recompile.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1d03f85136b2c811"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}