{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/are-large-language-models-geospatially","title":"Are Large Language Models Geospatially Knowledgeable?","arxiv_id":"2310.13002","date":"2023-10-09","proceeding":null,"authors":["Prabin Bhandari","Antonios Anastasopoulos","Dieter Pfoser"],"abstract":"Despite the impressive performance of Large Language Models (LLM) for various natural language processing tasks, little is known about their comprehension of geographic data and related ability to facilitate informed geospatial decision-making. This paper investigates the extent of geospatial knowledge, awareness, and reasoning abilities encoded within such pretrained LLMs. With a focus on autoregressive language models, we devise experimental approaches related to (i) probing LLMs for geo-coordinates to assess geospatial knowledge, (ii) using geospatial and non-geospatial prepositions to gauge their geospatial awareness, and (iii) utilizing a multidimensional scaling (MDS) experiment to assess the models' geospatial reasoning capabilities and to determine locations of cities based on prompting. Our results confirm that it does not only take larger, but also more sophisticated LLMs to synthesize geospatial knowledge from textual information. As such, this research contributes to understanding the potential and limitations of LLMs in dealing with geospatial information.","url_abs":"https://arxiv.org/abs/2310.13002v1","url_pdf":"https://arxiv.org/pdf/2310.13002v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"are-large-language-models-geospatially","repo_url":"https://github.com/prabin525/spatial-llm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2310.13002","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.13002"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/prabin525/spatial-llm","reach":{"status":"ok"}}],"summary":{"ran":3,"unverified":4},"by_repo_kind":{"official":{"samples":7,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"65b2a42378b2d751","entry":"gen_coor_lm","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction/predict_coor.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction/predict_coor.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"65b2a42378b2d751"}},{"code_sha256_prefix":"a56a44dcc10fee7c","entry":"min_max_scaler","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction-from-distance/helpers.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction-from-distance/helpers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a56a44dcc10fee7c"}},{"code_sha256_prefix":"30e621049e24d04d","entry":"transform_umeyama","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction-from-distance/helpers.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction-from-distance/helpers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"30e621049e24d04d"}},{"code_sha256_prefix":"8403ec770a54e9f2","entry":"format_tokens","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction/predict_coor.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction/predict_coor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8403ec770a54e9f2"}},{"code_sha256_prefix":"88978733b5f425b4","entry":"gen_coor_alpaca","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction/predict_coor.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction/predict_coor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"88978733b5f425b4"}},{"code_sha256_prefix":"587f0b27309387a5","entry":"gen_dis","repo":"prabin525/spatial-llm","repo_kind":"official","path":"coor-prediction-from-distance/gen_dis.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/coor-prediction-from-distance/gen_dis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"587f0b27309387a5"}},{"code_sha256_prefix":"19a597482205ce0a","entry":"gen_sen","repo":"prabin525/spatial-llm","repo_kind":"official","path":"spatial-awareness/gen_sen.py","file_url":"https://github.com/prabin525/spatial-llm/blob/HEAD/spatial-awareness/gen_sen.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"19a597482205ce0a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}