{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/attentional-aggregation-of-deep-feature-sets","title":"Robust Attentional Aggregation of Deep Feature Sets for Multi-view 3D Reconstruction","arxiv_id":"1808.00758","date":"2018-08-02","proceeding":null,"authors":["Bo Yang","Sen Wang","Andrew Markham","Niki Trigoni"],"abstract":"We study the problem of recovering an underlying 3D shape from a set of images. Existing learning based approaches usually resort to recurrent neural nets, e.g., GRU, or intuitive pooling operations, e.g., max/mean poolings, to fuse multiple deep features encoded from input images. However, GRU based approaches are unable to consistently estimate 3D shapes given different permutations of the same set of input images as the recurrent unit is permutation variant. It is also unlikely to refine the 3D shape given more images due to the long-term memory loss of GRU. Commonly used pooling approaches are limited to capturing partial information, e.g., max/mean values, ignoring other valuable features. In this paper, we present a new feed-forward neural module, named AttSets, together with a dedicated training algorithm, named FASet, to attentively aggregate an arbitrarily sized deep feature set for multi-view 3D reconstruction. The AttSets module is permutation invariant, computationally efficient and flexible to implement, while the FASet algorithm enables the AttSets based network to be remarkably robust and generalize to an arbitrary number of input images. We thoroughly evaluate FASet and the properties of AttSets on multiple large public datasets. Extensive experiments show that AttSets together with FASet algorithm significantly outperforms existing aggregation approaches.","url_abs":"https://arxiv.org/abs/1808.00758v2","url_pdf":"https://arxiv.org/pdf/1808.00758v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"attentional-aggregation-of-deep-feature-sets","repo_url":"https://github.com/Yang7879/AttSets","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-object-reconstruction","task_name":"3D Object Reconstruction"},{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"multi-view-3d-reconstruction","task_name":"Multi-View 3D Reconstruction"}],"methods":[{"method_slug":"gru","method_name":"GRU"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-reconstruction-on-data3dr2n2","task":"3D Reconstruction","dataset":"Data3D−R2N2","model":"AttSets","rank_in_archive_order":1,"of":4,"metrics":{"3DIoU":"0.642"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1808.00758","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1808.00758"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Yang7879/AttSets","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":3,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ba966c4838f2c939","entry":"read_header","repo":"Yang7879/AttSets","repo_kind":"official","path":"binvox_rw.py","file_url":"https://github.com/Yang7879/AttSets/blob/HEAD/binvox_rw.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ba966c4838f2c939"}},{"code_sha256_prefix":"2021d2aec4546384","entry":"read_as_3d_array","repo":"Yang7879/AttSets","repo_kind":"official","path":"binvox_rw.py","file_url":"https://github.com/Yang7879/AttSets/blob/HEAD/binvox_rw.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2021d2aec4546384"}},{"code_sha256_prefix":"74e08d52a8b6e172","entry":"read_as_coord_array","repo":"Yang7879/AttSets","repo_kind":"official","path":"binvox_rw.py","file_url":"https://github.com/Yang7879/AttSets/blob/HEAD/binvox_rw.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74e08d52a8b6e172"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}