{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/predicting-the-future-of-ai-with-ai-high","title":"Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge network","arxiv_id":"2210.00881","date":"2022-09-23","proceeding":null,"authors":["Mario Krenn","Lorenzo Buffoni","Bruno Coutinho","Sagi Eppel","Jacob Gates Foster","Andrew Gritsevskiy","Harlin Lee","Yichao Lu","Joao P. Moutinho","Nima Sanjabi","Rishi Sonthalia","Ngoc Mai Tran","Francisco Valente","Yangxinyu Xie","Rose Yu","Michael Kopp"],"abstract":"A tool that could suggest new personalized research directions and ideas by taking insights from the scientific literature could significantly accelerate the progress of science. A field that might benefit from such an approach is artificial intelligence (AI) research, where the number of scientific publications has been growing exponentially over the last years, making it challenging for human researchers to keep track of the progress. Here, we use AI techniques to predict the future research directions of AI itself. We develop a new graph-based benchmark based on real-world data -- the Science4Cast benchmark, which aims to predict the future state of an evolving semantic network of AI. For that, we use more than 100,000 research papers and build up a knowledge network with more than 64,000 concept nodes. We then present ten diverse methods to tackle this task, ranging from pure statistical to pure learning methods. Surprisingly, the most powerful methods use a carefully curated set of network features, rather than an end-to-end AI approach. It indicates a great potential that can be unleashed for purely ML approaches without human knowledge. Ultimately, better predictions of new future research directions will be a crucial component of more advanced research suggestion tools.","url_abs":"https://arxiv.org/abs/2210.00881v1","url_pdf":"https://arxiv.org/pdf/2210.00881v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"predicting-the-future-of-ai-with-ai-high","repo_url":"https://github.com/artificial-scientist-lab/futureofaiviaai","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"predicting-the-future-of-ai-with-ai-high","repo_url":"https://github.com/mariokrenn6240/futureofaiviaai","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"link-prediction","task_name":"Link Prediction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2210.00881","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.00881"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/artificial-scientist-lab/futureofaiviaai","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mariokrenn6240/futureofaiviaai","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":9},"by_repo_kind":{"official":{"samples":10,"ran":1,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"62adafae2a119c5b","entry":"compute_all_properties","repo":"artificial-scientist-lab/futureofaiviaai","repo_kind":"official","path":"simple_model.py","file_url":"https://github.com/artificial-scientist-lab/futureofaiviaai/blob/HEAD/simple_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"62adafae2a119c5b"}},{"code_sha256_prefix":"9d76c0156356112e","entry":"calculate_ROC","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9d76c0156356112e"}},{"code_sha256_prefix":"8ffff7266946484c","entry":"compute_all_properties_of_list","repo":"artificial-scientist-lab/futureofaiviaai","repo_kind":"official","path":"simple_model.py","file_url":"https://github.com/artificial-scientist-lab/futureofaiviaai/blob/HEAD/simple_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8ffff7266946484c"}},{"code_sha256_prefix":"e1a24d3ff1567fa3","entry":"create_training_data","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1a24d3ff1567fa3"}},{"code_sha256_prefix":"6f5486f96f306824","entry":"create_training_data_biased","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f5486f96f306824"}},{"code_sha256_prefix":"e46ca6110a4f762a","entry":"format_date","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"all_models/M1/preprocess_utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/all_models/M1/preprocess_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e46ca6110a4f762a"}},{"code_sha256_prefix":"1f0d759c1b18412f","entry":"get_jaccard_coefficient","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"all_models/M1/preprocess_utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/all_models/M1/preprocess_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f0d759c1b18412f"}},{"code_sha256_prefix":"c9faa55b49581385","entry":"read_json","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"all_models/M1/file_utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/all_models/M1/file_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9faa55b49581385"}},{"code_sha256_prefix":"c65e76b6f3277e6e","entry":"read_pickle","repo":"mariokrenn6240/futureofaiviaai","repo_kind":"official","path":"all_models/M1/file_utils.py","file_url":"https://github.com/mariokrenn6240/futureofaiviaai/blob/HEAD/all_models/M1/file_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c65e76b6f3277e6e"}},{"code_sha256_prefix":"03fce2c442a63841","entry":"train_model","repo":"artificial-scientist-lab/futureofaiviaai","repo_kind":"official","path":"simple_model.py","file_url":"https://github.com/artificial-scientist-lab/futureofaiviaai/blob/HEAD/simple_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"03fce2c442a63841"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}