{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-change-you-want-to-see-now-in-3d","title":"The Change You Want to See (Now in 3D)","arxiv_id":"2308.10417","date":"2023-08-21","proceeding":null,"authors":["Ragav Sachdeva","Andrew Zisserman"],"abstract":"The goal of this paper is to detect what has changed, if anything, between two \"in the wild\" images of the same 3D scene acquired from different camera positions and at different temporal instances. The open-set nature of this problem, occlusions/dis-occlusions due to the shift in viewpoint, and the lack of suitable training datasets, presents substantial challenges in devising a solution. To address this problem, we contribute a change detection model that is trained entirely on synthetic data and is class-agnostic, yet it is performant out-of-the-box on real world images without requiring fine-tuning. Our solution entails a \"register and difference\" approach that leverages self-supervised frozen embeddings and feature differences, which allows the model to generalise to a wide variety of scenes and domains. The model is able to operate directly on two RGB images, without requiring access to ground truth camera intrinsics, extrinsics, depth maps, point clouds, or additional before-after images. Finally, we collect and release a new evaluation dataset consisting of real-world image pairs with human-annotated differences and demonstrate the efficacy of our method. The code, datasets and pre-trained model can be found at: https://github.com/ragavsachdeva/CYWS-3D","url_abs":"https://arxiv.org/abs/2308.10417v2","url_pdf":"https://arxiv.org/pdf/2308.10417v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-change-you-want-to-see-now-in-3d","repo_url":"https://github.com/ragavsachdeva/cyws-3d","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"the-change-you-want-to-see-now-in-3d","repo_url":"https://github.com/ragavsachdeva/the-change-you-want-to-see","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"change-detection","task_name":"Change Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2308.10417","atlas_url":"https://app.syntology.ai/?focus=2308.10417","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.10417"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ragavsachdeva/the-change-you-want-to-see","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ragavsachdeva/cyws-3d","reach":null}],"summary":{"ran_draft_wrong":2,"ran_fixture":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1},"listed":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"f5188fdeb36d89e1","entry":"fix_pos_enc","repo":"ragavsachdeva/cyws-3d","repo_kind":"official","path":"modules/model.py","file_url":"https://github.com/ragavsachdeva/cyws-3d/blob/HEAD/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f5188fdeb36d89e1"}},{"code_sha256_prefix":"8f4089d4cd964241","entry":"import_dataloader_collate_fn","repo":"ragavsachdeva/the-change-you-want-to-see","repo_kind":"listed","path":"demo_single_pair.py","file_url":"https://github.com/ragavsachdeva/the-change-you-want-to-see/blob/HEAD/demo_single_pair.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"DEP_MISSING","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8f4089d4cd964241"}},{"code_sha256_prefix":"accd7067c76486c8","entry":"patch_vit_resolution","repo":"ragavsachdeva/cyws-3d","repo_kind":"official","path":"modules/model.py","file_url":"https://github.com/ragavsachdeva/cyws-3d/blob/HEAD/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"accd7067c76486c8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}