{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/self-supervised-adversarial-training-of","title":"Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks","arxiv_id":"2406.05857","date":"2024-06-09","proceeding":null,"authors":["Zhiyuan Cheng","Cheng Han","James Liang","Qifan Wang","Xiangyu Zhang","Dongfang Liu"],"abstract":"Monocular Depth Estimation (MDE) plays a vital role in applications such as autonomous driving. However, various attacks target MDE models, with physical attacks posing significant threats to system security. Traditional adversarial training methods, which require ground-truth labels, are not directly applicable to MDE models that lack ground-truth depth. Some self-supervised model hardening techniques (e.g., contrastive learning) overlook the domain knowledge of MDE, resulting in suboptimal performance. In this work, we introduce a novel self-supervised adversarial training approach for MDE models, leveraging view synthesis without the need for ground-truth depth. We enhance adversarial robustness against real-world attacks by incorporating L_0-norm-bounded perturbation during training. We evaluate our method against supervised learning-based and contrastive learning-based approaches specifically designed for MDE. Our experiments with two representative MDE networks demonstrate improved robustness against various adversarial attacks, with minimal impact on benign performance.","url_abs":"https://arxiv.org/abs/2406.05857v1","url_pdf":"https://arxiv.org/pdf/2406.05857v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"self-supervised-adversarial-training-of","repo_url":"https://github.com/Bob-cheng/DepthModelHardening","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"adversarial-robustness","task_name":"Adversarial Robustness"},{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"contrastive-learning","task_name":"Contrastive Learning"},{"task_slug":"depth-estimation","task_name":"Depth Estimation"},{"task_slug":"monocular-depth-estimation","task_name":"Monocular Depth Estimation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.05857","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.05857"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Bob-cheng/DepthModelHardening","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"ran":8,"ran_violates":1,"ran_honours":1,"unverified":6},"by_repo_kind":{"official":{"samples":17,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a8814cc5c348b987","entry":"batch_post_process_disparity","repo":"bob-cheng/depthmodelhardening","repo_kind":"official","path":"DepthNetworks/monodepth2/evaluate_depth.py","file_url":"https://github.com/bob-cheng/depthmodelhardening/blob/HEAD/DepthNetworks/monodepth2/evaluate_depth.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a8814cc5c348b987"}},{"code_sha256_prefix":"cccc24a3d20a9987","entry":"compute_ate","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"DepthNetworks/depth-hints/evaluate_pose.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/DepthNetworks/depth-hints/evaluate_pose.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cccc24a3d20a9987"}},{"code_sha256_prefix":"71a2780a460fb55e","entry":"compute_errors","repo":"bob-cheng/depthmodelhardening","repo_kind":"official","path":"DepthNetworks/monodepth2/evaluate_depth.py","file_url":"https://github.com/bob-cheng/depthmodelhardening/blob/HEAD/DepthNetworks/monodepth2/evaluate_depth.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"71a2780a460fb55e"}},{"code_sha256_prefix":"edd4f86e8f02732f","entry":"compute_errors","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"DepthNetworks/depth-hints/evaluate_depth_old.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/DepthNetworks/depth-hints/evaluate_depth_old.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"edd4f86e8f02732f"}},{"code_sha256_prefix":"62287188376f0ba0","entry":"disp_to_depth","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"depth_model.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/depth_model.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"62287188376f0ba0"}},{"code_sha256_prefix":"5ddbb1ceaa5ee4e9","entry":"disp_to_depth","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"my_utils.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/my_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5ddbb1ceaa5ee4e9"}},{"code_sha256_prefix":"0881d8bc3d8f6958","entry":"dump_xyz","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"DepthNetworks/depth-hints/evaluate_pose.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/DepthNetworks/depth-hints/evaluate_pose.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0881d8bc3d8f6958"}},{"code_sha256_prefix":"dde6b59baec616a6","entry":"get_mean_depth_diff","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"my_utils.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/my_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dde6b59baec616a6"}},{"code_sha256_prefix":"deb9787d1bb70773","entry":"lin_interp","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"dataLoader.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/dataLoader.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"deb9787d1bb70773"}},{"code_sha256_prefix":"15cbf0f1a95fa7c0","entry":"load_and_preprocess_intrinsics","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"depth_model.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/depth_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15cbf0f1a95fa7c0"}},{"code_sha256_prefix":"28f0d87414159ae0","entry":"readPathFiles","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"dataLoader.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/dataLoader.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"28f0d87414159ae0"}},{"code_sha256_prefix":"70e2744feb71bee5","entry":"eval_depth_diff","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"my_utils.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/my_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"70e2744feb71bee5"}},{"code_sha256_prefix":"5fd18fbd334c67fe","entry":"import_depth_model","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"depth_model.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/depth_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5fd18fbd334c67fe"}},{"code_sha256_prefix":"803f2bd90f370619","entry":"pil_loader","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"dataLoader.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/dataLoader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"803f2bd90f370619"}},{"code_sha256_prefix":"1c9e00a872e5f1ca","entry":"process_car_img","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"image_preprocess.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/image_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c9e00a872e5f1ca"}},{"code_sha256_prefix":"15fe5d7084a8f164","entry":"process_img","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"image_preprocess.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/image_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15fe5d7084a8f164"}},{"code_sha256_prefix":"3cafefe1573485fd","entry":"process_mask","repo":"Bob-cheng/DepthModelHardening","repo_kind":"official","path":"image_preprocess.py","file_url":"https://github.com/Bob-cheng/DepthModelHardening/blob/HEAD/image_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3cafefe1573485fd"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}