{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-narrowing-of-ai-research","title":"A narrowing of AI research?","arxiv_id":"2009.10385","date":"2020-09-22","proceeding":null,"authors":["Joel Klinger","Juan Mateos-Garcia","Konstantinos Stathoulopoulos"],"abstract":"The arrival of deep learning techniques able to infer patterns from large datasets has dramatically improved the performance of Artificial Intelligence (AI) systems. Deep learning's rapid development and adoption, in great part led by large technology companies, has however created concerns about a premature narrowing in the technological trajectory of AI research despite its weaknesses, which include lack of robustness, high environmental costs, and potentially unfair outcomes. We seek to improve the evidence base with a semantic analysis of AI research in arXiv, a popular pre-prints database. We study the evolution of the thematic diversity of AI research, compare the thematic diversity of AI research in academia and the private sector and measure the influence of private companies in AI research through the citations they receive and their collaborations with other institutions. Our results suggest that diversity in AI research has stagnated in recent years, and that AI research involving the private sector tends to be less diverse and more influential than research in academia. We also find that private sector AI researchers tend to specialise in data-hungry and computationally intensive deep learning methods at the expense of research involving other AI methods, research that considers the societal and ethical implications of AI, and applications in sectors like health. Our results provide a rationale for policy action to prevent a premature narrowing of AI research that could constrain its societal benefits, but we note the informational, incentive and scale hurdles standing in the way of such interventions.","url_abs":"https://arxiv.org/abs/2009.10385v4","url_pdf":"https://arxiv.org/pdf/2009.10385v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"a-narrowing-of-ai-research","repo_url":"https://github.com/nestauk/narrowing_ai_research","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2009.10385","atlas_url":"https://app.syntology.ai/?focus=2009.10385","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2009.10385"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nestauk/narrowing_ai_research","reach":null}],"summary":{"ran_draft_wrong":2,"ran_honours":1},"by_repo_kind":{"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"495d844a4717b01e","entry":"create_ids","repo":"nestauk/narrowing_ai_research","repo_kind":"listed","path":"narrowing_ai_research/paper/make_category_diversity.py","file_url":"https://github.com/nestauk/narrowing_ai_research/blob/HEAD/narrowing_ai_research/paper/make_category_diversity.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"495d844a4717b01e"}},{"code_sha256_prefix":"f14b2a1dceb51cd1","entry":"create_org_ids","repo":"nestauk/narrowing_ai_research","repo_kind":"listed","path":"narrowing_ai_research/paper/make_org_diversity.py","file_url":"https://github.com/nestauk/narrowing_ai_research/blob/HEAD/narrowing_ai_research/paper/make_org_diversity.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f14b2a1dceb51cd1"}},{"code_sha256_prefix":"88c2e7b310abe025","entry":"make_diversity_contribution_df","repo":"nestauk/narrowing_ai_research","repo_kind":"listed","path":"narrowing_ai_research/paper/make_topic_diversity_contribution.py","file_url":"https://github.com/nestauk/narrowing_ai_research/blob/HEAD/narrowing_ai_research/paper/make_topic_diversity_contribution.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"88c2e7b310abe025"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}