{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-visual-navigation-perspective-for-category","title":"A Visual Navigation Perspective for Category-Level Object Pose Estimation","arxiv_id":"2203.13572","date":"2022-03-25","proceeding":null,"authors":["Jiaxin Guo","Fangxun Zhong","Rong Xiong","Yunhui Liu","Yue Wang","Yiyi Liao"],"abstract":"This paper studies category-level object pose estimation based on a single monocular image. Recent advances in pose-aware generative models have paved the way for addressing this challenging task using analysis-by-synthesis. The idea is to sequentially update a set of latent variables, e.g., pose, shape, and appearance, of the generative model until the generated image best agrees with the observation. However, convergence and efficiency are two challenges of this inference procedure. In this paper, we take a deeper look at the inference of analysis-by-synthesis from the perspective of visual navigation, and investigate what is a good navigation policy for this specific task. We evaluate three different strategies, including gradient descent, reinforcement learning and imitation learning, via thorough comparisons in terms of convergence, robustness and efficiency. Moreover, we show that a simple hybrid approach leads to an effective and efficient solution. We further compare these strategies to state-of-the-art methods, and demonstrate superior performance on synthetic and real-world datasets leveraging off-the-shelf pose-aware generative models.","url_abs":"https://arxiv.org/abs/2203.13572v2","url_pdf":"https://arxiv.org/pdf/2203.13572v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-visual-navigation-perspective-for-category","repo_url":"https://github.com/wrld/visual_navigation_pose_estimation","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"imitation-learning","task_name":"Imitation Learning"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.13572","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.13572"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wrld/visual_navigation_pose_estimation","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":2,"unverified":15},"by_repo_kind":{"official":{"samples":17,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6154e3744ece5728","entry":"create_window","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/losses.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/losses.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6154e3744ece5728"}},{"code_sha256_prefix":"c56b7ef16f309a45","entry":"gaussian","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/losses.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/losses.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c56b7ef16f309a45"}},{"code_sha256_prefix":"5bd96fb5938773d4","entry":"actvn","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/networks.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bd96fb5938773d4"}},{"code_sha256_prefix":"5be53270342b91a6","entry":"compute_RotMats","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/utils/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5be53270342b91a6"}},{"code_sha256_prefix":"2757c39fd1d64ab6","entry":"compute_iou","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"nocs/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/nocs/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2757c39fd1d64ab6"}},{"code_sha256_prefix":"d8f86755404a2057","entry":"compute_overlaps","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"nocs/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/nocs/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d8f86755404a2057"}},{"code_sha256_prefix":"966e21cead161e27","entry":"euler2mat","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/networks.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"966e21cead161e27"}},{"code_sha256_prefix":"75499b9fb42b31f7","entry":"extract_bboxes","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"nocs/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/nocs/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75499b9fb42b31f7"}},{"code_sha256_prefix":"774db7133dd29213","entry":"grid_sample","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"774db7133dd29213"}},{"code_sha256_prefix":"3980d98cced8b905","entry":"init_variable","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3980d98cced8b905"}},{"code_sha256_prefix":"a9881435918e1dc4","entry":"remove_spectral_norm","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/spectral_norm.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/spectral_norm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9881435918e1dc4"}},{"code_sha256_prefix":"01df6fccefdc574e","entry":"rot","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/networks.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/networks.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"01df6fccefdc574e"}},{"code_sha256_prefix":"65e457d25bcad96a","entry":"rot_error","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/utils/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65e457d25bcad96a"}},{"code_sha256_prefix":"9cf6a2515e727176","entry":"spectral_norm","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/spectral_norm.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/spectral_norm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9cf6a2515e727176"}},{"code_sha256_prefix":"b21bebe6240b182c","entry":"ssim","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/losses.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b21bebe6240b182c"}},{"code_sha256_prefix":"af3c4a71bdfa4413","entry":"trans_error","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/utils/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af3c4a71bdfa4413"}},{"code_sha256_prefix":"bec655e3507fba1e","entry":"warping_grid","repo":"wrld/visual_navigation_pose_estimation","repo_kind":"official","path":"models/networks/utils.py","file_url":"https://github.com/wrld/visual_navigation_pose_estimation/blob/HEAD/models/networks/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bec655e3507fba1e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}