{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/show-me-what-and-where-has-changed-question","title":"Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change Detection","arxiv_id":"2410.23828","date":"2024-10-31","proceeding":null,"authors":["Ke Li","Fuyu Dong","Di Wang","Shaofeng Li","Quan Wang","Xinbo Gao","Tat-Seng Chua"],"abstract":"Remote sensing change detection aims to perceive changes occurring on the Earth's surface from remote sensing data in different periods, and feed these changes back to humans. However, most existing methods only focus on detecting change regions, lacking the capability to interact with users to identify changes that the users expect. In this paper, we introduce a new task named Change Detection Question Answering and Grounding (CDQAG), which extends the traditional change detection task by providing interpretable textual answers and intuitive visual evidence. To this end, we construct the first CDQAG benchmark dataset, termed QAG-360K, comprising over 360K triplets of questions, textual answers, and corresponding high-quality visual masks. It encompasses 10 essential land-cover categories and 8 comprehensive question types, which provides a valuable and diverse dataset for remote sensing applications. Furthermore, we present VisTA, a simple yet effective baseline method that unifies the tasks of question answering and grounding by delivering both visual and textual answers. Our method achieves state-of-the-art results on both the classic change detection-based visual question answering (CDVQA) and the proposed CDQAG datasets. Extensive qualitative and quantitative experimental results provide useful insights for developing better CDQAG models, and we hope that our work can inspire further research in this important yet underexplored research field. The proposed benchmark dataset and method are available at https://github.com/like413/VisTA.","url_abs":"https://arxiv.org/abs/2410.23828v2","url_pdf":"https://arxiv.org/pdf/2410.23828v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"show-me-what-and-where-has-changed-question","repo_url":"https://github.com/like413/vista","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"change-detection","task_name":"Change Detection"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"visual-question-answering-1","task_name":"Visual Question Answering"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.23828","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.23828"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/like413/vista","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran_draft_wrong":5,"ran":1,"unverified":2},"by_repo_kind":{"official":{"samples":8,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"98f385d847636a3e","entry":"basic_clean","repo":"like413/vista","repo_kind":"official","path":"VisTA/dataset/simple_tokenizer.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/dataset/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"98f385d847636a3e"}},{"code_sha256_prefix":"dbfe3357dc25ca5f","entry":"conv_layer","repo":"like413/vista","repo_kind":"official","path":"VisTA/model/layers.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/model/layers.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dbfe3357dc25ca5f"}},{"code_sha256_prefix":"210ba8a40d178d14","entry":"get_logger","repo":"like413/vista","repo_kind":"official","path":"VisTA/utils/logger.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/utils/logger.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"210ba8a40d178d14"}},{"code_sha256_prefix":"d919ae32e5e4e616","entry":"get_pairs","repo":"like413/vista","repo_kind":"official","path":"VisTA/dataset/simple_tokenizer.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/dataset/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d919ae32e5e4e616"}},{"code_sha256_prefix":"89f9fd49ddec76ba","entry":"linear_layer","repo":"like413/vista","repo_kind":"official","path":"VisTA/model/layers.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/model/layers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89f9fd49ddec76ba"}},{"code_sha256_prefix":"9542161e9640b858","entry":"whitespace_clean","repo":"like413/vista","repo_kind":"official","path":"VisTA/dataset/simple_tokenizer.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/dataset/simple_tokenizer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9542161e9640b858"}},{"code_sha256_prefix":"d761a6dca9831c24","entry":"build_model","repo":"like413/vista","repo_kind":"official","path":"VisTA/model/clip.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/model/clip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d761a6dca9831c24"}},{"code_sha256_prefix":"7067b1efd38efa76","entry":"make_answer_vec","repo":"like413/vista","repo_kind":"official","path":"VisTA/dataset/DataNew.py","file_url":"https://github.com/like413/vista/blob/HEAD/VisTA/dataset/DataNew.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7067b1efd38efa76"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}