| Title: |
Applying and adapting established frameworks for geospatial data quality to evaluate Generative AI in geographic information tasks |
| Authors: |
Shingleton, Joseph; Basiri, Ana |
| Publisher Information: |
Taylor and Francis |
| Publication Year: |
2025 |
| Collection: |
University of Glasgow: Enlighten - Publications |
| Description: |
Challenges such as hallucination and non-determinism are well known to undermine the reliability of Generative AI (GenAI) applications. Despite this, their use across multiple fields and domains continues to rapidly grow. Many GenAI applications now generate or interact with geospatial information – leading to the potential proliferation of non-human generated geospatial data. Because such tools can be developed without specialist geographic expertise, there is a growing risk of diminished oversight and declining geospatial data quality. This paper presents an approach for evaluating the geospatial information produced by large language models (LLMs) using established frameworks for geospatial data quality. We apply this framework in two experiments that assess the completeness, accuracy, precision, and consistency of LLM outputs: geoparsing and route finding. Interpreting these results through ontological and teleological perspectives reveals fundamental limitations in how LLMs represent and reason about space. The study highlights the need for responsible evaluation and adaptation of data quality standards as GenAI becomes increasingly embedded within geographic information science. |
| Document Type: |
article in journal/newspaper |
| File Description: |
text |
| Language: |
English |
| Relation: |
https://eprints.gla.ac.uk/373517/1/373517.pdf; Shingleton, Joseph ORCID logoorcid:0000-0002-1628-3231 and Basiri, Ana ORCID logoorcid:0000-0002-2399-1797 (2025) Applying and adapting established frameworks for geospatial data quality to evaluate Generative AI in geographic information tasks. Journal of Location Based Services , (doi:10.1080/17489725.2025.2594193 ) (Early Online Publication) |
| DOI: |
10.1080/17489725.2025.2594193 |
| Availability: |
https://eprints.gla.ac.uk/373517/; https://eprints.gla.ac.uk/373517/1/373517.pdf; https://doi.org/10.1080/17489725.2025.2594193 |
| Rights: |
cc_by_4 |
| Accession Number: |
edsbas.6889FC83 |
| Database: |
BASE |