{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/graphgpt-graph-instruction-tuning-for-large","title":"GraphGPT: Graph Instruction Tuning for Large Language Models","arxiv_id":"2310.13023","date":"2023-10-19","proceeding":null,"authors":["Jiabin Tang","Yuhao Yang","Wei Wei","Lei Shi","Lixin Su","Suqi Cheng","Dawei Yin","Chao Huang"],"abstract":"Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation. Traditional methods often depend on fine-tuning with task-specific labels, limiting their effectiveness when labeled data is scarce. Our research tackles this by advancing graph model generalization in zero-shot learning environments. Inspired by the success of large language models (LLMs), we aim to create a graph-oriented LLM capable of exceptional generalization across various datasets and tasks without relying on downstream graph data. We introduce the GraphGPT framework, which integrates LLMs with graph structural knowledge through graph instruction tuning. This framework includes a text-graph grounding component to link textual and graph structures and a dual-stage instruction tuning approach with a lightweight graph-text alignment projector. These innovations allow LLMs to comprehend complex graph structures and enhance adaptability across diverse datasets and tasks. Our framework demonstrates superior generalization in both supervised and zero-shot graph learning tasks, surpassing existing benchmarks. The open-sourced model implementation of our GraphGPT is available at https://github.com/HKUDS/GraphGPT.","url_abs":"https://arxiv.org/abs/2310.13023v3","url_pdf":"https://arxiv.org/pdf/2310.13023v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"graphgpt-graph-instruction-tuning-for-large","repo_url":"https://github.com/HKUDS/GraphGPT","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"graph-learning","task_name":"Graph Learning"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2310.13023","atlas_url":"https://app.syntology.ai/?focus=2310.13023","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.13023"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/HKUDS/GraphGPT","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"ran_draft_wrong":3,"ran_violates":1,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"80dde39da1ba3708","entry":"compress","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/compression.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/compression.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"80dde39da1ba3708"}},{"code_sha256_prefix":"649fc48067a48529","entry":"find_all_linear_names","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/GraphLlama_pl.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/GraphLlama_pl.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"649fc48067a48529"}},{"code_sha256_prefix":"c5824da57107fe8c","entry":"get_compressed_list","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/compression.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/compression.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c5824da57107fe8c"}},{"code_sha256_prefix":"a730a935c1f257ae","entry":"load_compress_model","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/compression.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/compression.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a730a935c1f257ae"}},{"code_sha256_prefix":"48e990ea1b99a86d","entry":"load_model_pretrained","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/GraphLlama.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/GraphLlama.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"48e990ea1b99a86d"}},{"code_sha256_prefix":"0bf414a2b44babe6","entry":"raise_warning_for_incompatible_cpu_offloading_configuration","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/model_adapter.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/model_adapter.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0bf414a2b44babe6"}},{"code_sha256_prefix":"17582c82f42bd6a2","entry":"transfer_param_tograph","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/GraphLlama.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/GraphLlama.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"17582c82f42bd6a2"}},{"code_sha256_prefix":"bad3bd3ae89b22d3","entry":"load_pretrained_model","repo":"HKUDS/GraphGPT","repo_kind":"official","path":"graphgpt/model/builder.py","file_url":"https://github.com/HKUDS/GraphGPT/blob/HEAD/graphgpt/model/builder.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bad3bd3ae89b22d3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}