{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/accelerating-large-scale-real-time-gnn","title":"Accelerating Large Scale Real-Time GNN Inference using Channel Pruning","arxiv_id":"2105.04528","date":"2021-05-10","proceeding":null,"authors":["Hongkuan Zhou","Ajitesh Srivastava","Hanqing Zeng","Rajgopal Kannan","Viktor Prasanna"],"abstract":"Graph Neural Networks (GNNs) are proven to be powerful models to generate node embedding for downstream applications. However, due to the high computation complexity of GNN inference, it is hard to deploy GNNs for large-scale or real-time applications. In this paper, we propose to accelerate GNN inference by pruning the dimensions in each layer with negligible accuracy loss. Our pruning framework uses a novel LASSO regression formulation for GNNs to identify feature dimensions (channels) that have high influence on the output activation. We identify two inference scenarios and design pruning schemes based on their computation and memory usage for each. To further reduce the inference complexity, we effectively store and reuse hidden features of visited nodes, which significantly reduces the number of supporting nodes needed to compute the target embedding. We evaluate the proposed method with the node classification problem on five popular datasets and a real-time spam detection application. We demonstrate that the pruned GNN models greatly reduce computation and memory usage with little accuracy loss. For full inference, the proposed method achieves an average of 3.27x speedup with only 0.002 drop in F1-Micro on GPU. For batched inference, the proposed method achieves an average of 6.67x speedup with only 0.003 drop in F1-Micro on CPU. To the best of our knowledge, we are the first to accelerate large scale real-time GNN inference through channel pruning.","url_abs":"https://arxiv.org/abs/2105.04528v1","url_pdf":"https://arxiv.org/pdf/2105.04528v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"accelerating-large-scale-real-time-gnn","repo_url":"https://github.com/tedzhouhk/GCNP","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":null,"task_name":"CPU"},{"task_slug":null,"task_name":"GPU"},{"task_slug":"node-classification","task_name":"Node Classification"},{"task_slug":"spam-detection","task_name":"Spam detection"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2105.04528","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.04528"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tedzhouhk/GCNP","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"abd93718f606fd86","entry":"calc_f1","repo":"tedzhouhk/GCNP","repo_kind":"official","path":"GNN/metric.py","file_url":"https://github.com/tedzhouhk/GCNP/blob/HEAD/GNN/metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"abd93718f606fd86"}},{"code_sha256_prefix":"4623accb00c7b6f7","entry":"evaluate_full_batch","repo":"tedzhouhk/GCNP","repo_kind":"official","path":"GNN/pytorch_version/load_tensorflow_model.py","file_url":"https://github.com/tedzhouhk/GCNP/blob/HEAD/GNN/pytorch_version/load_tensorflow_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4623accb00c7b6f7"}},{"code_sha256_prefix":"2a31ea18cd40e5ea","entry":"load_data","repo":"tedzhouhk/GCNP","repo_kind":"official","path":"GNN/utils.py","file_url":"https://github.com/tedzhouhk/GCNP/blob/HEAD/GNN/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a31ea18cd40e5ea"}},{"code_sha256_prefix":"228a19cda5326b8c","entry":"parse_layer_yml","repo":"tedzhouhk/GCNP","repo_kind":"official","path":"GNN/utils.py","file_url":"https://github.com/tedzhouhk/GCNP/blob/HEAD/GNN/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"228a19cda5326b8c"}},{"code_sha256_prefix":"1c9066cfcac05682","entry":"process_graph_data","repo":"tedzhouhk/GCNP","repo_kind":"official","path":"GNN/utils.py","file_url":"https://github.com/tedzhouhk/GCNP/blob/HEAD/GNN/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c9066cfcac05682"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}