{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-train-test-class-overlap-and-detection-for","title":"On Train-Test Class Overlap and Detection for Image Retrieval","arxiv_id":"2404.01524","date":"2024-04-01","proceeding":"CVPR 2024 1","authors":["Chull Hwan Song","Jooyoung Yoon","Taebaek Hwang","Shunghyun Choi","Yeong Hyeon Gu","Yannis Avrithis"],"abstract":"How important is it for training and evaluation sets to not have class overlap in image retrieval? We revisit Google Landmarks v2 clean, the most popular training set, by identifying and removing class overlap with Revisited Oxford and Paris [34], the most popular evaluation set. By comparing the original and the new RGLDv2-clean on a benchmark of reproduced state-of-the-art methods, our findings are striking. Not only is there a dramatic drop in performance, but it is inconsistent across methods, changing the ranking.What does it take to focus on objects or interest and ignore background clutter when indexing? Do we need to train an object detector and the representation separately? Do we need location supervision? We introduce Single-stage Detect-to-Retrieve (CiDeR), an end-to-end, single-stage pipeline to detect objects of interest and extract a global image representation. We outperform previous state-of-the-art on both existing training sets and the new RGLDv2-clean. Our dataset is available at https://github.com/dealicious-inc/RGLDv2-clean.","url_abs":"https://arxiv.org/abs/2404.01524v1","url_pdf":"https://arxiv.org/pdf/2404.01524v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2404.01524","atlas_url":"https://app.syntology.ai/?focus=2404.01524","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.01524"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/dealiciousinc/RGLDv2-clean","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/MCC-WH/Token","reach":null}],"summary":{"ran":3,"ran_fixture":1,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":7,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"938eafe395be5d19","entry":"DropPath","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"938eafe395be5d19"}},{"code_sha256_prefix":"c26ff4de58c5e4df","entry":"Encoder","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c26ff4de58c5e4df"}},{"code_sha256_prefix":"acdcf1b7fddda414","entry":"Identity","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"acdcf1b7fddda414"}},{"code_sha256_prefix":"e37b79debce8d027","entry":"drop_path","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e37b79debce8d027"}},{"code_sha256_prefix":"1703890780718a9f","entry":"Attention","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1703890780718a9f"}},{"code_sha256_prefix":"8a4d4f2d03d0fdee","entry":"Decoder","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a4d4f2d03d0fdee"}},{"code_sha256_prefix":"0551ba36e5ad98d3","entry":"Token_Refine","repo":"MCC-WH/Token","repo_kind":"found_in_text","path":"networks/RetrievalNet.py","file_url":"https://github.com/MCC-WH/Token/blob/HEAD/networks/RetrievalNet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0551ba36e5ad98d3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}