{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/self-supervised-similarity-search-for-large","title":"Self-supervised similarity search for large scientific datasets","arxiv_id":"2110.13151","date":"2021-10-25","proceeding":null,"authors":["George Stein","Peter Harrington","Jacqueline Blaum","Tomislav Medan","Zarija Lukic"],"abstract":"We present the use of self-supervised learning to explore and exploit large unlabeled datasets. Focusing on 42 million galaxy images from the latest data release of the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys, we first train a self-supervised model to distill low-dimensional representations that are robust to symmetries, uncertainties, and noise in each image. We then use the representations to construct and publicly release an interactive semantic similarity search tool. We demonstrate how our tool can be used to rapidly discover rare objects given only a single example, increase the speed of crowd-sourcing campaigns, and construct and improve training sets for supervised applications. While we focus on images from sky surveys, the technique is straightforward to apply to any scientific dataset of any dimensionality. The similarity search web app can be found at https://github.com/georgestein/galaxy_search","url_abs":"https://arxiv.org/abs/2110.13151v2","url_pdf":"https://arxiv.org/pdf/2110.13151v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"self-supervised-similarity-search-for-large","repo_url":"https://github.com/georgestein/galaxy_search","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"self-supervised-similarity-search-for-large","repo_url":"https://github.com/georgestein/ssl-legacysurvey","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"semantic-similarity","task_name":"Semantic Similarity"},{"task_slug":"semantic-textual-similarity","task_name":"Semantic Textual Similarity"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2110.13151","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.13151"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/georgestein/galaxy_search","reach":{"status":"ok","spdx":"GPL-3.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/georgestein/ssl-legacysurvey","reach":null}],"summary":{"ran_fixture":1,"ran_honours":2},"by_repo_kind":{"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2b9700703933892f","entry":"find_nearest","repo":"georgestein/ssl-legacysurvey","repo_kind":"listed","path":"scripts/similarity_search_nxn.py","file_url":"https://github.com/georgestein/ssl-legacysurvey/blob/HEAD/scripts/similarity_search_nxn.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b9700703933892f"}},{"code_sha256_prefix":"1b277beb6f1500df","entry":"get_dataset_size","repo":"georgestein/ssl-legacysurvey","repo_kind":"listed","path":"scripts/similarity_search_nxn.py","file_url":"https://github.com/georgestein/ssl-legacysurvey/blob/HEAD/scripts/similarity_search_nxn.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b277beb6f1500df"}},{"code_sha256_prefix":"fbced10bb9c48822","entry":"load_rep_chunk","repo":"georgestein/ssl-legacysurvey","repo_kind":"listed","path":"scripts/similarity_search_nxn.py","file_url":"https://github.com/georgestein/ssl-legacysurvey/blob/HEAD/scripts/similarity_search_nxn.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fbced10bb9c48822"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}