{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/graphllm-boosting-graph-reasoning-ability-of","title":"GraphLLM: Boosting Graph Reasoning Ability of Large Language Model","arxiv_id":"2310.05845","date":"2023-10-09","proceeding":null,"authors":["Ziwei Chai","Tianjie Zhang","Liang Wu","Kaiqiao Han","Xiaohai Hu","Xuanwen Huang","Yang Yang"],"abstract":"The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to images and audio. Despite this progress, a critical gap remains in empowering LLMs to proficiently understand and reason on graph data. Recent studies underscore LLMs' underwhelming performance on fundamental graph reasoning tasks. In this paper, we endeavor to unearth the obstacles that impede LLMs in graph reasoning, pinpointing the common practice of converting graphs into natural language descriptions (Graph2Text) as a fundamental bottleneck. To overcome this impediment, we introduce GraphLLM, a pioneering end-to-end approach that synergistically integrates graph learning models with LLMs. This synergy equips LLMs with the ability to proficiently interpret and reason on graph data, harnessing the superior expressive power of graph learning models. Our empirical evaluations across four fundamental graph reasoning tasks validate the effectiveness of GraphLLM. The results exhibit a substantial average accuracy enhancement of 54.44%, alongside a noteworthy context reduction of 96.45% across various graph reasoning tasks.","url_abs":"https://arxiv.org/abs/2310.05845v1","url_pdf":"https://arxiv.org/pdf/2310.05845v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"graphllm-boosting-graph-reasoning-ability-of","repo_url":"https://github.com/mistyreed63849/graph-llm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"graph-learning","task_name":"Graph Learning"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"large-language-model","task_name":"Large Language Model"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.05845","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.05845"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mistyreed63849/graph-llm","reach":{"status":"ok"}}],"summary":{"ran":6,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":7,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"64f0661697a6aa77","entry":"adjust_learning_rate","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"utils/lr_sched.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/utils/lr_sched.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"64f0661697a6aa77"}},{"code_sha256_prefix":"805a829ea56dc75c","entry":"expand_mask","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"llama/model_utils.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/llama/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"805a829ea56dc75c"}},{"code_sha256_prefix":"25efd5592c652449","entry":"make_causal_mask","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"llama/model_utils.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/llama/model_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"25efd5592c652449"}},{"code_sha256_prefix":"7bc4a632170a3b29","entry":"preprocess_function_original_mts","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"utils/dataset_preprocess.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/utils/dataset_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7bc4a632170a3b29"}},{"code_sha256_prefix":"61924b3fbb1f6470","entry":"preprocess_function_original_sc","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"utils/dataset_preprocess.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/utils/dataset_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"61924b3fbb1f6470"}},{"code_sha256_prefix":"1bdb1681b2ccbec0","entry":"preprocess_function_original_sp","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"utils/dataset_preprocess.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/utils/dataset_preprocess.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1bdb1681b2ccbec0"}},{"code_sha256_prefix":"8845976729f4c4ee","entry":"sample_top_p","repo":"mistyreed63849/graph-llm","repo_kind":"official","path":"llama/model_utils.py","file_url":"https://github.com/mistyreed63849/graph-llm/blob/HEAD/llama/model_utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8845976729f4c4ee"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}