{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/structure-aware-sparse-view-x-ray-3d","title":"Structure-Aware Sparse-View X-ray 3D Reconstruction","arxiv_id":"2311.10959","date":"2023-11-18","proceeding":"CVPR 2024 1","authors":["Yuanhao Cai","Jiahao Wang","Alan Yuille","Zongwei Zhou","Angtian Wang"],"abstract":"X-ray, known for its ability to reveal internal structures of objects, is expected to provide richer information for 3D reconstruction than visible light. Yet, existing neural radiance fields (NeRF) algorithms overlook this important nature of X-ray, leading to their limitations in capturing structural contents of imaged objects. In this paper, we propose a framework, Structure-Aware X-ray Neural Radiodensity Fields (SAX-NeRF), for sparse-view X-ray 3D reconstruction. Firstly, we design a Line Segment-based Transformer (Lineformer) as the backbone of SAX-NeRF. Linefomer captures internal structures of objects in 3D space by modeling the dependencies within each line segment of an X-ray. Secondly, we present a Masked Local-Global (MLG) ray sampling strategy to extract contextual and geometric information in 2D projection. Plus, we collect a larger-scale dataset X3D covering wider X-ray applications. Experiments on X3D show that SAX-NeRF surpasses previous NeRF-based methods by 12.56 and 2.49 dB on novel view synthesis and CT reconstruction. Code, models, and data are released at https://github.com/caiyuanhao1998/SAX-NeRF","url_abs":"https://arxiv.org/abs/2311.10959v3","url_pdf":"https://arxiv.org/pdf/2311.10959v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"structure-aware-sparse-view-x-ray-3d","repo_url":"https://github.com/caiyuanhao1998/sax-nerf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"structure-aware-sparse-view-x-ray-3d","repo_url":"https://github.com/cmhungsteve/Awesome-Transformer-Attention","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"ct-reconstruction","task_name":"CT Reconstruction"},{"task_slug":"low-dose-x-ray-ct-reconstruction","task_name":"Low-Dose X-Ray Ct Reconstruction"},{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[{"slug":"x3d","name":"X3D","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/low-dose-x-ray-ct-reconstruction-on-x3d","task":"Low-Dose X-Ray Ct Reconstruction","dataset":"X3D","model":"SAX-NeRF","rank_in_archive_order":1,"of":9,"metrics":{"PSNR":"37.25","SSIM":"0.9753"},"uses_additional_data":false},{"leaderboard":"/sota/low-dose-x-ray-ct-reconstruction-on-x3d","task":"Low-Dose X-Ray Ct Reconstruction","dataset":"X3D","model":"SART","rank_in_archive_order":5,"of":9,"metrics":{"PSNR":"32.33","SSIM":"0.9342"},"uses_additional_data":false},{"leaderboard":"/sota/low-dose-x-ray-ct-reconstruction-on-x3d","task":"Low-Dose X-Ray Ct Reconstruction","dataset":"X3D","model":"ASD-POCS","rank_in_archive_order":6,"of":9,"metrics":{"PSNR":"32.32","SSIM":"0.9400"},"uses_additional_data":false},{"leaderboard":"/sota/low-dose-x-ray-ct-reconstruction-on-x3d","task":"Low-Dose X-Ray Ct Reconstruction","dataset":"X3D","model":"FDK","rank_in_archive_order":9,"of":9,"metrics":{"PSNR":"25.12","SSIM":"0.6422"},"uses_additional_data":false},{"leaderboard":"/sota/novel-view-synthesis-on-x3d","task":"Novel View Synthesis","dataset":"X3D","model":"SAX-NeRF","rank_in_archive_order":1,"of":6,"metrics":{"PSNR":"51.37","SSIM":"0.9994"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.10959","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.10959"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cmhungsteve/Awesome-Transformer-Attention","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/caiyuanhao1998/sax-nerf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":2,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"7b05a3d9d1780493","entry":"ray_merge","repo":"caiyuanhao1998/sax-nerf","repo_kind":"official","path":"src/network/Lineformer.py","file_url":"https://github.com/caiyuanhao1998/sax-nerf/blob/HEAD/src/network/Lineformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b05a3d9d1780493"}},{"code_sha256_prefix":"da6d053cc82e738f","entry":"ray_partition","repo":"caiyuanhao1998/sax-nerf","repo_kind":"official","path":"src/network/Lineformer.py","file_url":"https://github.com/caiyuanhao1998/sax-nerf/blob/HEAD/src/network/Lineformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da6d053cc82e738f"}},{"code_sha256_prefix":"c76d18678f19d332","entry":"trunc_normal_","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"c76d18678f19d332"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}