{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cad-signet-cad-language-inference-from-point","title":"CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attention","arxiv_id":"2402.17678","date":"2024-02-27","proceeding":"CVPR 2024 1","authors":["Mohammad Sadil Khan","Elona Dupont","Sk Aziz Ali","Kseniya Cherenkova","Anis Kacem","Djamila Aouada"],"abstract":"Reverse engineering in the realm of Computer-Aided Design (CAD) has been a longstanding aspiration, though not yet entirely realized. Its primary aim is to uncover the CAD process behind a physical object given its 3D scan. We propose CAD-SIGNet, an end-to-end trainable and auto-regressive architecture to recover the design history of a CAD model represented as a sequence of sketch-and-extrusion from an input point cloud. Our model learns visual-language representations by layer-wise cross-attention between point cloud and CAD language embedding. In particular, a new Sketch instance Guided Attention (SGA) module is proposed in order to reconstruct the fine-grained details of the sketches. Thanks to its auto-regressive nature, CAD-SIGNet not only reconstructs a unique full design history of the corresponding CAD model given an input point cloud but also provides multiple plausible design choices. This allows for an interactive reverse engineering scenario by providing designers with multiple next-step choices along with the design process. Extensive experiments on publicly available CAD datasets showcase the effectiveness of our approach against existing baseline models in two settings, namely, full design history recovery and conditional auto-completion from point clouds.","url_abs":"https://arxiv.org/abs/2402.17678v1","url_pdf":"https://arxiv.org/pdf/2402.17678v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"cad-reconstruction","task_name":"CAD Reconstruction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/cad-reconstruction-on-cc3d","task":"CAD Reconstruction","dataset":"CC3D","model":"CAD-SIGNet","rank_in_archive_order":3,"of":4,"metrics":{"Chamfer Distance":"32.6","Chamfer Distance (median)":"4.42","Invalid Ratio":"15.5","IoU":"39.1"},"uses_additional_data":false},{"leaderboard":"/sota/cad-reconstruction-on-deepcad","task":"CAD Reconstruction","dataset":"DeepCAD","model":"CAD-SIGNet","rank_in_archive_order":3,"of":11,"metrics":{"Camfer Distance (median)":"0.29","Chamfer Distance":"6.81","Invalidi Ratio":"5.0","IoU":"77.3"},"uses_additional_data":false},{"leaderboard":"/sota/cad-reconstruction-on-fusion-360-gallery","task":"CAD Reconstruction","dataset":"Fusion 360 Gallery","model":"CAD-SIGNet","rank_in_archive_order":9,"of":11,"metrics":{"Chamfer Distance":"14.5","Chamfer Distance (median)":"0.70","Invalid Ratio":"9.3","IoU":"58.4"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.17678","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}