{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/more-multi-order-relation-mining-for-dense","title":"MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes","arxiv_id":"2203.05203","date":"2022-03-10","proceeding":null,"authors":["Yang Jiao","Shaoxiang Chen","Zequn Jie","Jingjing Chen","Lin Ma","Yu-Gang Jiang"],"abstract":"3D dense captioning is a recently-proposed novel task, where point clouds contain more geometric information than the 2D counterpart. However, it is also more challenging due to the higher complexity and wider variety of inter-object relations contained in point clouds. Existing methods only treat such relations as by-products of object feature learning in graphs without specifically encoding them, which leads to sub-optimal results. In this paper, aiming at improving 3D dense captioning via capturing and utilizing the complex relations in the 3D scene, we propose MORE, a Multi-Order RElation mining model, to support generating more descriptive and comprehensive captions. Technically, our MORE encodes object relations in a progressive manner since complex relations can be deduced from a limited number of basic ones. We first devise a novel Spatial Layout Graph Convolution (SLGC), which semantically encodes several first-order relations as edges of a graph constructed over 3D object proposals. Next, from the resulting graph, we further extract multiple triplets which encapsulate basic first-order relations as the basic unit, and construct several Object-centric Triplet Attention Graphs (OTAG) to infer multi-order relations for every target object. The updated node features from OTAG are aggregated and fed into the caption decoder to provide abundant relational cues, so that captions including diverse relations with context objects can be generated. Extensive experiments on the Scan2Cap dataset prove the effectiveness of our proposed MORE and its components, and we also outperform the current state-of-the-art method. Our code is available at https://github.com/SxJyJay/MORE.","url_abs":"https://arxiv.org/abs/2203.05203v2","url_pdf":"https://arxiv.org/pdf/2203.05203v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"more-multi-order-relation-mining-for-dense","repo_url":"https://github.com/SxJyJay/MORE","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-dense-captioning","task_name":"3D dense captioning"},{"task_slug":"dense-captioning","task_name":"Dense Captioning"},{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"object","task_name":"Object"},{"task_slug":null,"task_name":"Relation"},{"task_slug":null,"task_name":"Triplet"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"triplet-attention","method_name":"Triplet Attention"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-dense-captioning-on-scanrefer-dataset","task":"3D dense captioning","dataset":"ScanRefer Dataset","model":"MORE","rank_in_archive_order":7,"of":12,"metrics":{"BLEU-4":"35.41","CIDEr":"58.89","METEOR":"26.36","ROUGE-L":"55.41"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.05203","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.05203"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/SxJyJay/MORE","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":1,"ran_honours":1,"unverified":7},"by_repo_kind":{"official":{"samples":9,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d209e4ea51338ac8","entry":"create_enet","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/enet.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/enet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d209e4ea51338ac8"}},{"code_sha256_prefix":"eddd23cbbb297813","entry":"flip_axis_to_camera","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/ap_helper.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/ap_helper.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"eddd23cbbb297813"}},{"code_sha256_prefix":"4795981076ddc399","entry":"check_candidates","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/eval_helper.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/eval_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4795981076ddc399"}},{"code_sha256_prefix":"3e1db4a4fe30db4a","entry":"compute_cap_loss","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/loss_helper_pretrained.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/loss_helper_pretrained.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3e1db4a4fe30db4a"}},{"code_sha256_prefix":"f9f6ab5de42cc2d4","entry":"create_enet_for_3d","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/enet.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/enet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f9f6ab5de42cc2d4"}},{"code_sha256_prefix":"239555e6188daee7","entry":"decode_caption","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/eval_helper.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/eval_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"239555e6188daee7"}},{"code_sha256_prefix":"d638b0201b9a9ece","entry":"flip_axis_to_depth","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/ap_helper.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/ap_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d638b0201b9a9ece"}},{"code_sha256_prefix":"79493094543ea699","entry":"radian_to_label","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/loss_helper_pretrained.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/loss_helper_pretrained.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"79493094543ea699"}},{"code_sha256_prefix":"1a034a72c15f9903","entry":"softmax","repo":"SxJyJay/MORE","repo_kind":"official","path":"lib/ap_helper.py","file_url":"https://github.com/SxJyJay/MORE/blob/HEAD/lib/ap_helper.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1a034a72c15f9903"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}