{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/orientation-aware-semantic-segmentation-on","title":"Orientation-aware Semantic Segmentation on Icosahedron Spheres","arxiv_id":"1907.12849","date":"2019-07-30","proceeding":"ICCV 2019 10","authors":["Chao Zhang","Stephan Liwicki","William Smith","Roberto Cipolla"],"abstract":"We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an icosahedron mesh, but systems are typically rotation invariant or require significant memory and parameters, thus enabling execution only at very low resolutions. In our work, we propose an orientation-aware CNN framework for the icosahedron mesh. Our representation allows for fast network operations, as our design simplifies to standard network operations of classical CNNs, but under consideration of north-aligned kernel convolutions for features on the sphere. We implement our representation and demonstrate its memory efficiency up-to a level-8 resolution mesh (equivalent to 640 x 1024 equirectangular images). Finally, since our kernels operate on the tangent of the sphere, standard feature weights, pretrained on perspective data, can be directly transferred with only small need for weight refinement. In our evaluation our orientation-aware CNN becomes a new state of the art for the recent 2D3DS dataset, and our Omni-SYNTHIA version of SYNTHIA. Rotation invariant classification and segmentation tasks are additionally presented for comparison to prior art.","url_abs":"https://arxiv.org/abs/1907.12849v1","url_pdf":"https://arxiv.org/pdf/1907.12849v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"orientation-aware-semantic-segmentation-on","repo_url":"https://github.com/matsuren/HexRUNet_pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/semantic-segmentation-on-stanford2d3d-1","task":"Semantic Segmentation","dataset":"Stanford2D3D Panoramic","model":"HexRUNet","rank_in_archive_order":21,"of":25,"metrics":{"mAcc":"58.6","mIoU":"43.3%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1907.12849","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.12849"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/matsuren/HexRUNet_pytorch","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"listed":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ce42e7036f068561","entry":"genuv","repo":"matsuren/HexRUNet_pytorch","repo_kind":"listed","path":"utils/projection_helper.py","file_url":"https://github.com/matsuren/HexRUNet_pytorch/blob/HEAD/utils/projection_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce42e7036f068561"}},{"code_sha256_prefix":"f11924d473e9d2bd","entry":"get_unfold_icosahedron","repo":"matsuren/HexRUNet_pytorch","repo_kind":"listed","path":"utils/geometry_helper.py","file_url":"https://github.com/matsuren/HexRUNet_pytorch/blob/HEAD/utils/geometry_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f11924d473e9d2bd"}},{"code_sha256_prefix":"1b3db7ec8d750bd8","entry":"get_unfold_imgcoord","repo":"matsuren/HexRUNet_pytorch","repo_kind":"listed","path":"utils/geometry_helper.py","file_url":"https://github.com/matsuren/HexRUNet_pytorch/blob/HEAD/utils/geometry_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b3db7ec8d750bd8"}},{"code_sha256_prefix":"a7bc3ed9660ca10a","entry":"uv2xyz","repo":"matsuren/HexRUNet_pytorch","repo_kind":"listed","path":"utils/projection_helper.py","file_url":"https://github.com/matsuren/HexRUNet_pytorch/blob/HEAD/utils/projection_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7bc3ed9660ca10a"}},{"code_sha256_prefix":"354420e492429761","entry":"xyz2uv","repo":"matsuren/HexRUNet_pytorch","repo_kind":"listed","path":"utils/projection_helper.py","file_url":"https://github.com/matsuren/HexRUNet_pytorch/blob/HEAD/utils/projection_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"354420e492429761"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}