{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/gslb-the-graph-structure-learning-benchmark-1","title":"GSLB: The Graph Structure Learning Benchmark","arxiv_id":"2310.05174","date":"2023-10-08","proceeding":"NeurIPS 2023 11","authors":["ZHIXUN LI","Xin Sun","Yifan Luo","Yanqiao Zhu","Dingshuo Chen","Yingtao Luo","Xiangxin Zhou","Qiang Liu","Shu Wu","Liang Wang","Jeffrey Xu Yu"],"abstract":"Graph Structure Learning (GSL) has recently garnered considerable attention due to its ability to optimize both the parameters of Graph Neural Networks (GNNs) and the computation graph structure simultaneously. Despite the proliferation of GSL methods developed in recent years, there is no standard experimental setting or fair comparison for performance evaluation, which creates a great obstacle to understanding the progress in this field. To fill this gap, we systematically analyze the performance of GSL in different scenarios and develop a comprehensive Graph Structure Learning Benchmark (GSLB) curated from 20 diverse graph datasets and 16 distinct GSL algorithms. Specifically, GSLB systematically investigates the characteristics of GSL in terms of three dimensions: effectiveness, robustness, and complexity. We comprehensively evaluate state-of-the-art GSL algorithms in node- and graph-level tasks, and analyze their performance in robust learning and model complexity. Further, to facilitate reproducible research, we have developed an easy-to-use library for training, evaluating, and visualizing different GSL methods. Empirical results of our extensive experiments demonstrate the ability of GSL and reveal its potential benefits on various downstream tasks, offering insights and opportunities for future research. The code of GSLB is available at: https://github.com/GSL-Benchmark/GSLB.","url_abs":"https://arxiv.org/abs/2310.05174v1","url_pdf":"https://arxiv.org/pdf/2310.05174v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"gslb-the-graph-structure-learning-benchmark-1","repo_url":"https://github.com/gsl-benchmark/gslb","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"graph-structure-learning","task_name":"Graph structure learning"}],"methods":[{"method_slug":null,"method_name":"Library"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.05174","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.05174"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/GSL-Benchmark/GSLB","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gsl-benchmark/gslb","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6d3cc45509b2eae4","entry":"cal_similarity_graph","repo":"GSL-Benchmark/GSLB","repo_kind":"official","path":"metric.py","file_url":"https://github.com/GSL-Benchmark/GSLB/blob/HEAD/metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6d3cc45509b2eae4"}},{"code_sha256_prefix":"67b9a22b1bcf510b","entry":"cosine_sim_torch","repo":"GSL-Benchmark/GSLB","repo_kind":"official","path":"model/gsr.py","file_url":"https://github.com/GSL-Benchmark/GSLB/blob/HEAD/model/gsr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"67b9a22b1bcf510b"}},{"code_sha256_prefix":"cc9c74f5df741aef","entry":"get_subdict","repo":"GSL-Benchmark/GSLB","repo_kind":"official","path":"encoder/metamodule.py","file_url":"https://github.com/GSL-Benchmark/GSLB/blob/HEAD/encoder/metamodule.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc9c74f5df741aef"}},{"code_sha256_prefix":"4c1106c3a93bd726","entry":"construct_cogsl_data","repo":"GSL-Benchmark/GSLB","repo_kind":"official","path":"model/cogsl.py","file_url":"https://github.com/GSL-Benchmark/GSLB/blob/HEAD/model/cogsl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4c1106c3a93bd726"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}