{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/temporal-graph-benchmark-for-machine-learning-1","title":"Temporal Graph Benchmark for Machine Learning on Temporal Graphs","arxiv_id":"2307.01026","date":"2023-07-03","proceeding":"NeurIPS 2023 11","authors":["Shenyang Huang","Farimah Poursafaei","Jacob Danovitch","Matthias Fey","Weihua Hu","Emanuele Rossi","Jure Leskovec","Michael Bronstein","Guillaume Rabusseau","Reihaneh Rabbany"],"abstract":"We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale, spanning years in duration, incorporate both node and edge-level prediction tasks and cover a diverse set of domains including social, trade, transaction, and transportation networks. For both tasks, we design evaluation protocols based on realistic use-cases. We extensively benchmark each dataset and find that the performance of common models can vary drastically across datasets. In addition, on dynamic node property prediction tasks, we show that simple methods often achieve superior performance compared to existing temporal graph models. We believe that these findings open up opportunities for future research on temporal graphs. Finally, TGB provides an automated machine learning pipeline for reproducible and accessible temporal graph research, including data loading, experiment setup and performance evaluation. TGB will be maintained and updated on a regular basis and welcomes community feedback. TGB datasets, data loaders, example codes, evaluation setup, and leaderboards are publicly available at https://tgb.complexdatalab.com/.","url_abs":"https://arxiv.org/abs/2307.01026v2","url_pdf":"https://arxiv.org/pdf/2307.01026v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/shenyanghuang/tgb","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/fpour/tgb_baselines","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/juliagast/tgb2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/laixinn/tgb","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"temporal-graph-benchmark-for-machine-learning-1","repo_url":"https://github.com/timpostuvan/tgb-link-anomaly-detection-baselines","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"node-property-prediction","task_name":"Node Property Prediction"},{"task_slug":"property-prediction","task_name":"Property Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.01026","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.01026"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fpour/tgb_baselines","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/juliagast/tgb2","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shenyanghuang/tgb","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/timpostuvan/tgb-link-anomaly-detection-baselines","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/laixinn/tgb","reach":{"status":"ok"}}],"summary":{"ran":4,"ran_fixture":1,"unverified":2},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1},"listed":{"samples":5,"ran":4,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"727d90514a9a5475","entry":"compute_src_dst_node_time_shifts","repo":"timpostuvan/CTDG-link-anomaly-detection","repo_kind":"listed","path":"models/MemoryModel.py","file_url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection/blob/HEAD/models/MemoryModel.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"727d90514a9a5475"}},{"code_sha256_prefix":"1de6e005e59cdf96","entry":"edge_bank_time_window_memory","repo":"timpostuvan/CTDG-link-anomaly-detection","repo_kind":"listed","path":"models/EdgeBank.py","file_url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection/blob/HEAD/models/EdgeBank.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1de6e005e59cdf96"}},{"code_sha256_prefix":"0f56e3ae8a152b2b","entry":"edge_bank_unlimited_memory","repo":"timpostuvan/CTDG-link-anomaly-detection","repo_kind":"listed","path":"models/EdgeBank.py","file_url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection/blob/HEAD/models/EdgeBank.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f56e3ae8a152b2b"}},{"code_sha256_prefix":"8bcef3dc22f0489a","entry":"predict_link_probabilities","repo":"timpostuvan/CTDG-link-anomaly-detection","repo_kind":"listed","path":"models/EdgeBank.py","file_url":"https://github.com/timpostuvan/CTDG-link-anomaly-detection/blob/HEAD/models/EdgeBank.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8bcef3dc22f0489a"}},{"code_sha256_prefix":"cd2a79c0b37aca42","entry":"query_pred_edge_batch","repo":"fpour/tgb_baselines","repo_kind":"official","path":"evaluation/tgb_evaluate_LPP.py","file_url":"https://github.com/fpour/tgb_baselines/blob/HEAD/evaluation/tgb_evaluate_LPP.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cd2a79c0b37aca42"}},{"code_sha256_prefix":"b4d6c154d75cb68b","entry":"get_link_prediction_args","repo":"fpour/tgb_baselines","repo_kind":"official","path":"utils/load_configs.py","file_url":"https://github.com/fpour/tgb_baselines/blob/HEAD/utils/load_configs.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4d6c154d75cb68b"}},{"code_sha256_prefix":"8a0919d4b2ca1705","entry":"query_pred_edge_batch","repo":"timpostuvan/tgb-link-anomaly-detection-baselines","repo_kind":"listed","path":"evaluation/tgb_evaluate_linkanomdet.py","file_url":"https://github.com/timpostuvan/tgb-link-anomaly-detection-baselines/blob/HEAD/evaluation/tgb_evaluate_linkanomdet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a0919d4b2ca1705"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}