Review, framework, and future perspectives of Geographic Knowledge Graph (GeoKG) quality assessment

Abstract

High-quality Geographic Knowledge Graphs (GeoKGs) are highly anticipated for their potential to provide reliable semantic support in geographical knowledge reasoning, training Geographic Large Language Models (Geo-LLMs), enabling geographical recommendation, and facilitating various geospatial knowledge-driven tasks. However, there is a lack of a standardized quality assessment methodology and clearly defined evaluative indicators in the field of GeoKGs research. This research uses the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to conduct a systematic review of literature and standards in the field of GeoKG in an effort to fill the gap. First, using the lifecycle theory as a guide, we outline and propose five groups including twenty assessment criteria and their accompanying calculation techniques for evaluating GeoKG quality. Then, expanding on this foundation, we present a streamlined evaluation scheme for GeoKGs that relies on just seven key measures, discussing their applicability, utility, and weight scheme in greater detail. After applying the GeoKG quality framework, we stated three key tasks emerge as priorities: the creation of specialized assessment tools, the formation of worldwide standards, and the building of large-scale, high-quality GeoKGs. We believe this thorough and systematic GeoKG quality assessment technique will help construct high-quality GeoKGs and promote GeoKGs as an engine for geo-intelligence applications including Geospatial Artificial Intelligence (GeoAI) systems, Sustainable Development Goals (SDGs) analyzers, and Virtual Geographic Environments (VGEs) models.

Keywords

• Geographic Knowledge Graph (GeoKG)
• Quality Assessment
• Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)
• assessment indicators
• metrics
• quality evaluation