{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cheating-depth-enhancing-3d-surface-anomaly","title":"Cheating Depth: Enhancing 3D Surface Anomaly Detection via Depth Simulation","arxiv_id":"2311.01117","date":"2023-11-02","proceeding":null,"authors":["Vitjan Zavrtanik","Matej Kristan","Danijel Skočaj"],"abstract":"RGB-based surface anomaly detection methods have advanced significantly. However, certain surface anomalies remain practically invisible in RGB alone, necessitating the incorporation of 3D information. Existing approaches that employ point-cloud backbones suffer from suboptimal representations and reduced applicability due to slow processing. Re-training RGB backbones, designed for faster dense input processing, on industrial depth datasets is hindered by the limited availability of sufficiently large datasets. We make several contributions to address these challenges. (i) We propose a novel Depth-Aware Discrete Autoencoder (DADA) architecture, that enables learning a general discrete latent space that jointly models RGB and 3D data for 3D surface anomaly detection. (ii) We tackle the lack of diverse industrial depth datasets by introducing a simulation process for learning informative depth features in the depth encoder. (iii) We propose a new surface anomaly detection method 3DSR, which outperforms all existing state-of-the-art on the challenging MVTec3D anomaly detection benchmark, both in terms of accuracy and processing speed. The experimental results validate the effectiveness and efficiency of our approach, highlighting the potential of utilizing depth information for improved surface anomaly detection.","url_abs":"https://arxiv.org/abs/2311.01117v1","url_pdf":"https://arxiv.org/pdf/2311.01117v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cheating-depth-enhancing-3d-surface-anomaly","repo_url":"https://github.com/vitjanz/3dsr","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"depth-anomaly-detection-and-segmentation","task_name":"Depth Anomaly Detection and Segmentation"},{"task_slug":"rgb-3d-anomaly-detection-and-segmentation","task_name":"RGB+3D Anomaly Detection and Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/depth-anomaly-detection-and-segmentation-on","task":"Depth Anomaly Detection and Segmentation","dataset":"MVTEC 3D-AD","model":"3DSR (3D)","rank_in_archive_order":6,"of":13,"metrics":{"Detection AUROC":"0.922","Segmentation AUPRO":"0.907"},"uses_additional_data":false},{"leaderboard":"/sota/rgb-3d-anomaly-detection-and-segmentation-on","task":"RGB+3D Anomaly Detection and Segmentation","dataset":"MVTEC 3D-AD","model":"3DSR","rank_in_archive_order":2,"of":9,"metrics":{"Detection AUCROC":"0.978","Segmentation AUCROC":"0.995","Segmentation AUPRO":"0.972"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.01117","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.01117"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vitjanz/3dsr","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9a1b7e14c45e1cf9","entry":"shuffle_patches","repo":"vitjanz/3dsr","repo_kind":"official","path":"train_dsr_depth.py","file_url":"https://github.com/vitjanz/3dsr/blob/HEAD/train_dsr_depth.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9a1b7e14c45e1cf9"}},{"code_sha256_prefix":"78d5b0f1aa8b87e0","entry":"generate_fake_anomalies_joined","repo":"vitjanz/3dsr","repo_kind":"official","path":"train_dsr_depth.py","file_url":"https://github.com/vitjanz/3dsr/blob/HEAD/train_dsr_depth.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"78d5b0f1aa8b87e0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}