{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/talos-enhancing-semantic-scene-completion-via","title":"TALoS: Enhancing Semantic Scene Completion via Test-time Adaptation on the Line of Sight","arxiv_id":"2410.15674","date":"2024-10-21","proceeding":null,"authors":["Hyun-Kurl Jang","Jihun Kim","Hyeokjun Kweon","Kuk-Jin Yoon"],"abstract":"Semantic Scene Completion (SSC) aims to perform geometric completion and semantic segmentation simultaneously. Despite the promising results achieved by existing studies, the inherently ill-posed nature of the task presents significant challenges in diverse driving scenarios. This paper introduces TALoS, a novel test-time adaptation approach for SSC that excavates the information available in driving environments. Specifically, we focus on that observations made at a certain moment can serve as Ground Truth (GT) for scene completion at another moment. Given the characteristics of the LiDAR sensor, an observation of an object at a certain location confirms both 1) the occupation of that location and 2) the absence of obstacles along the line of sight from the LiDAR to that point. TALoS utilizes these observations to obtain self-supervision about occupancy and emptiness, guiding the model to adapt to the scene in test time. In a similar manner, we aggregate reliable SSC predictions among multiple moments and leverage them as semantic pseudo-GT for adaptation. Further, to leverage future observations that are not accessible at the current time, we present a dual optimization scheme using the model in which the update is delayed until the future observation is available. Evaluations on the SemanticKITTI validation and test sets demonstrate that TALoS significantly improves the performance of the pre-trained SSC model. Our code is available at https://github.com/blue-531/TALoS.","url_abs":"https://arxiv.org/abs/2410.15674v2","url_pdf":"https://arxiv.org/pdf/2410.15674v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"talos-enhancing-semantic-scene-completion-via","repo_url":"https://github.com/blue-531/talos","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"3d-semantic-scene-completion","task_name":"3D Semantic Scene Completion"},{"task_slug":"3d-semantic-segmentation","task_name":"3D Semantic Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"test-time-adaptation","task_name":"Test-time Adaptation"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-semantic-scene-completion-on-semantickitti","task":"3D Semantic Scene Completion","dataset":"SemanticKITTI","model":"TALoS","rank_in_archive_order":1,"of":20,"metrics":{"mIoU":"37.9"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.15674","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.15674"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/blue-531/TALoS","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/blue-531/talos","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":1,"ran_honours":2,"ran_fixture":2,"ran_violates":1,"unverified":11},"by_repo_kind":{"official":{"samples":17,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":17,"samples":[{"code_sha256_prefix":"261283216054e8b0","entry":"get_remap_first","repo":"blue-531/talos","repo_kind":"official","path":"run_tta_val.py","file_url":"https://github.com/blue-531/talos/blob/HEAD/run_tta_val.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"261283216054e8b0"}},{"code_sha256_prefix":"03a862c1bc4bb8d4","entry":"get_remap_second","repo":"blue-531/talos","repo_kind":"official","path":"run_tta_val.py","file_url":"https://github.com/blue-531/talos/blob/HEAD/run_tta_val.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"03a862c1bc4bb8d4"}},{"code_sha256_prefix":"d94639b28b2134ff","entry":"iou","repo":"blue-531/TALoS","repo_kind":"official","path":"utils/lovasz_losses.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/utils/lovasz_losses.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d94639b28b2134ff"}},{"code_sha256_prefix":"1211530cd527bd0b","entry":"iou_binary","repo":"blue-531/TALoS","repo_kind":"official","path":"utils/lovasz_losses.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/utils/lovasz_losses.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1211530cd527bd0b"}},{"code_sha256_prefix":"e85b5d21dc5b8382","entry":"lovasz_grad","repo":"blue-531/TALoS","repo_kind":"official","path":"utils/lovasz_losses.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/utils/lovasz_losses.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e85b5d21dc5b8382"}},{"code_sha256_prefix":"ae0ede157bf07297","entry":"train2SemKITTI","repo":"blue-531/talos","repo_kind":"official","path":"run_tta_val.py","file_url":"https://github.com/blue-531/talos/blob/HEAD/run_tta_val.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae0ede157bf07297"}},{"code_sha256_prefix":"f3d8ca81e8d0ee0c","entry":"SemKITTI2train","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/pc_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f3d8ca81e8d0ee0c"}},{"code_sha256_prefix":"3f9a651be8d4082c","entry":"extract_nonzero_features","repo":"blue-531/TALoS","repo_kind":"official","path":"network/segmentator_3d_asymm_spconv_unlock.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/network/segmentator_3d_asymm_spconv_unlock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3f9a651be8d4082c"}},{"code_sha256_prefix":"3d6928be33f7d1bb","entry":"frame_transform_scan","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/dataset_semantickitti.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/dataset_semantickitti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3d6928be33f7d1bb"}},{"code_sha256_prefix":"0a96d3b0c027f68e","entry":"from_voxel_to_voxel","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/dataset_semantickitti.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/dataset_semantickitti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0a96d3b0c027f68e"}},{"code_sha256_prefix":"237978845d0ee378","entry":"get_model_class","repo":"blue-531/TALoS","repo_kind":"official","path":"network/cylinder_spconv_3d_unlock.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/network/cylinder_spconv_3d_unlock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"237978845d0ee378"}},{"code_sha256_prefix":"dc3115f6b6438996","entry":"get_pc_model_class","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/pc_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dc3115f6b6438996"}},{"code_sha256_prefix":"1ff14b65ece70b32","entry":"manual_extraction","repo":"blue-531/TALoS","repo_kind":"official","path":"network/segmentator_3d_asymm_spconv_unlock.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/network/segmentator_3d_asymm_spconv_unlock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1ff14b65ece70b32"}},{"code_sha256_prefix":"936c2117da625a10","entry":"no_extraction","repo":"blue-531/TALoS","repo_kind":"official","path":"network/segmentator_3d_asymm_spconv_unlock.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/network/segmentator_3d_asymm_spconv_unlock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"936c2117da625a10"}},{"code_sha256_prefix":"c134fed586d67760","entry":"register_dataset","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/dataset_semantickitti.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/dataset_semantickitti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c134fed586d67760"}},{"code_sha256_prefix":"06a0e2786c57fc38","entry":"register_dataset","repo":"blue-531/TALoS","repo_kind":"official","path":"dataloader/pc_dataset.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/dataloader/pc_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"06a0e2786c57fc38"}},{"code_sha256_prefix":"9416a0d63c5a653a","entry":"register_model","repo":"blue-531/TALoS","repo_kind":"official","path":"network/cylinder_spconv_3d_unlock.py","file_url":"https://github.com/blue-531/TALoS/blob/HEAD/network/cylinder_spconv_3d_unlock.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9416a0d63c5a653a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}