{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/region-similarity-representation-learning","title":"Region Similarity Representation Learning","arxiv_id":"2103.12902","date":"2021-03-24","proceeding":"ICCV 2021 10","authors":["Tete Xiao","Colorado J Reed","Xiaolong Wang","Kurt Keutzer","Trevor Darrell"],"abstract":"We present Region Similarity Representation Learning (ReSim), a new approach to self-supervised representation learning for localization-based tasks such as object detection and segmentation. While existing work has largely focused on solely learning global representations for an entire image, ReSim learns both regional representations for localization as well as semantic image-level representations. ReSim operates by sliding a fixed-sized window across the overlapping area between two views (e.g., image crops), aligning these areas with their corresponding convolutional feature map regions, and then maximizing the feature similarity across views. As a result, ReSim learns spatially and semantically consistent feature representation throughout the convolutional feature maps of a neural network. A shift or scale of an image region, e.g., a shift or scale of an object, has a corresponding change in the feature maps; this allows downstream tasks to leverage these representations for localization. Through object detection, instance segmentation, and dense pose estimation experiments, we illustrate how ReSim learns representations which significantly improve the localization and classification performance compared to a competitive MoCo-v2 baseline: $+2.7$ AP$^{\\text{bb}}_{75}$ VOC, $+1.1$ AP$^{\\text{bb}}_{75}$ COCO, and $+1.9$ AP$^{\\text{mk}}$ Cityscapes. Code and pre-trained models are released at: \\url{https://github.com/Tete-Xiao/ReSim}","url_abs":"https://arxiv.org/abs/2103.12902v2","url_pdf":"https://arxiv.org/pdf/2103.12902v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"region-similarity-representation-learning","repo_url":"https://github.com/Tete-Xiao/ReSim","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2103.12902","atlas_url":"https://app.syntology.ai/?focus=2103.12902","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.12902"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/Tete-Xiao/ReSim","reach":null}],"summary":{"ran":2,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"bc4324df45fd643a","entry":"MoCo","repo":"Tete-Xiao/ReSim","repo_kind":"official","path":"moco/builder.py","file_url":"https://github.com/Tete-Xiao/ReSim/blob/HEAD/moco/builder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bc4324df45fd643a"}},{"code_sha256_prefix":"09437f377453bac2","entry":"PrRoIPool2DFunction","repo":"Tete-Xiao/ReSim","repo_kind":"official","path":"moco/builder.py","file_url":"https://github.com/Tete-Xiao/ReSim/blob/HEAD/moco/builder.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"09437f377453bac2"}},{"code_sha256_prefix":"3e242db47ba04fed","entry":"_import_prroi_pooling","repo":"Tete-Xiao/ReSim","repo_kind":"official","path":"moco/builder.py","file_url":"https://github.com/Tete-Xiao/ReSim/blob/HEAD/moco/builder.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"3e242db47ba04fed"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}