{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/global-correlated-3d-decoupling-transformer-1","title":"Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstruction","arxiv_id":"2309.13524","date":"2023-09-24","proceeding":"NeurIPS 2023 11","authors":["Zechuan Zhang","Li Sun","Zongxin Yang","Ling Chen","Yi Yang"],"abstract":"Reconstructing 3D clothed human avatars from single images is a challenging task, especially when encountering complex poses and loose clothing. Current methods exhibit limitations in performance, largely attributable to their dependence on insufficient 2D image features and inconsistent query methods. Owing to this, we present the Global-correlated 3D-decoupling Transformer for clothed Avatar reconstruction (GTA), a novel transformer-based architecture that reconstructs clothed human avatars from monocular images. Our approach leverages transformer architectures by utilizing a Vision Transformer model as an encoder for capturing global-correlated image features. Subsequently, our innovative 3D-decoupling decoder employs cross-attention to decouple tri-plane features, using learnable embeddings as queries for cross-plane generation. To effectively enhance feature fusion with the tri-plane 3D feature and human body prior, we propose a hybrid prior fusion strategy combining spatial and prior-enhanced queries, leveraging the benefits of spatial localization and human body prior knowledge. Comprehensive experiments on CAPE and THuman2.0 datasets illustrate that our method outperforms state-of-the-art approaches in both geometry and texture reconstruction, exhibiting high robustness to challenging poses and loose clothing, and producing higher-resolution textures. Codes will be available at https://github.com/River-Zhang/GTA.","url_abs":"https://arxiv.org/abs/2309.13524v3","url_pdf":"https://arxiv.org/pdf/2309.13524v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"global-correlated-3d-decoupling-transformer-1","repo_url":"https://github.com/river-zhang/gta","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"vision-transformer","method_name":"Vision Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.13524","atlas_url":"https://app.syntology.ai/?focus=2309.13524","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.13524"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/River-Zhang/GTA","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/river-zhang/gta","reach":{"status":"ok"}}],"summary":{"ran":14,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":18,"ran":15,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":18,"samples":[{"code_sha256_prefix":"d47a4cbea53360d1","entry":"Attention","repo":"river-zhang/gta","repo_kind":"official","path":"lib/net/Transformer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/lib/net/Transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d47a4cbea53360d1"}},{"code_sha256_prefix":"c770dc5d61e03875","entry":"CrossAttention","repo":"river-zhang/gta","repo_kind":"official","path":"lib/net/Transformer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/lib/net/Transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c770dc5d61e03875"}},{"code_sha256_prefix":"16245abf3ac1d730","entry":"CrossTransformer","repo":"river-zhang/gta","repo_kind":"official","path":"lib/net/Transformer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/lib/net/Transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"16245abf3ac1d730"}},{"code_sha256_prefix":"3059b2cea63f72e8","entry":"FeedForward","repo":"river-zhang/gta","repo_kind":"official","path":"lib/net/Transformer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/lib/net/Transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3059b2cea63f72e8"}},{"code_sha256_prefix":"ae274a9ba388ad5f","entry":"PreNorm","repo":"river-zhang/gta","repo_kind":"official","path":"lib/net/Transformer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/lib/net/Transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae274a9ba388ad5f"}},{"code_sha256_prefix":"c25753fc9d52f1fc","entry":"build_smooth_conv3D","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/seg3d_utils.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/seg3d_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c25753fc9d52f1fc"}},{"code_sha256_prefix":"c07f0db88d9cd069","entry":"create_grid2D","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/seg3d_utils.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/seg3d_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c07f0db88d9cd069"}},{"code_sha256_prefix":"8e3d9f38a1b40efc","entry":"create_grid3D","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/seg3d_utils.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/seg3d_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8e3d9f38a1b40efc"}},{"code_sha256_prefix":"0ac51880d133df40","entry":"gen_mesh_color","repo":"river-zhang/gta","repo_kind":"official","path":"apps/infer.py","file_url":"https://github.com/river-zhang/gta/blob/HEAD/apps/infer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0ac51880d133df40"}},{"code_sha256_prefix":"8f032be442a1aef5","entry":"gen_mesh_eval","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/train_util.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/train_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8f032be442a1aef5"}},{"code_sha256_prefix":"3433ad17bc7e6650","entry":"load_segmentation","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/cloth_extraction.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/cloth_extraction.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3433ad17bc7e6650"}},{"code_sha256_prefix":"27cd0667887a625b","entry":"parse_args","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/config.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/config.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"27cd0667887a625b"}},{"code_sha256_prefix":"66fb5ef9d96ef0a8","entry":"rename","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/train_util.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/train_util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"66fb5ef9d96ef0a8"}},{"code_sha256_prefix":"bd32d6f5d82a5a9e","entry":"solid_angles","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/render_utils.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/render_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bd32d6f5d82a5a9e"}},{"code_sha256_prefix":"cd54a895a2ab8720","entry":"winding_numbers","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/render_utils.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/render_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cd54a895a2ab8720"}},{"code_sha256_prefix":"79509ef34e0af8e4","entry":"reshape_sample_tensor","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/train_util.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/train_util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"79509ef34e0af8e4"}},{"code_sha256_prefix":"32b523249d5d7868","entry":"smpl_to_recon_labels","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/cloth_extraction.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/cloth_extraction.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"32b523249d5d7868"}},{"code_sha256_prefix":"938f7173c2e6ab9c","entry":"update_cfg","repo":"River-Zhang/GTA","repo_kind":"official","path":"lib/common/config.py","file_url":"https://github.com/River-Zhang/GTA/blob/HEAD/lib/common/config.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"938f7173c2e6ab9c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}