Review, framework, and future perspectives of Geographic Knowledge Graph (GeoKG) quality assessment

High-quality Geographic Knowledge Graphs (GeoKGs) are highly anticipated for their potential to provide reliable semantic support in geographical knowledge reasoning, training Geographic Large Language Models (Geo-LLMs), enabling geographical recommendation, and facilitating various geospatial knowledge-driven tasks. However, there is a lack of a standardized quality assessment methodology and clearly defined evaluative indicators in the field of GeoKGs research. This research uses the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to conduct a systematic review of literature and standards in the field of GeoKG in an effort to fill the gap. First, using the lifecycle theory as a guide, we outline and propose five groups including twenty assessment criteria and their accompanying calculation techniques for evaluating GeoKG quality. Then, expanding on this foundation, we present a streamlined evaluation scheme for GeoKGs that relies on just seven key measures, discussing their applicability, utility, and weight scheme in greater detail. After applying the GeoKG quality framework, we stated three key tasks emerge as priorities: the creation of specialized assessment tools, the formation of worldwide standards, and the building of large-scale, high-quality GeoKGs. We believe this thorough and systematic GeoKG quality assessment technique will help construct high-quality GeoKGs and promote GeoKGs as an engine for geo-intelligence applications including Geospatial Artificial Intelligence (GeoAI) systems, Sustainable Development Goals (SDGs) analyzers, and Virtual Geographic Environments (VGEs) models.

Authors

Institutions

Publication Details

Journal
Geo-spatial Information Science
Published
2024-09-20
DOI
https://doi.org/10.1080/10095020.2024.2403785
Citations
14
Primary Topic
Geographic Information Systems Studies
Type
article
Field-Weighted Citation Impact
27.39

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Review, framework, and future perspectives of Geographic Knowledge Graph (GeoKG) quality assessment

Yan Bai, Yunqiang Zhu, Peiyuan Qiu, Gengze Li et al.
14 citations
Geo-spatial Information Science
Geographic Information Systems Studies
27.39
article

Review, framework, and future perspectives of Geographic Knowledge Graph (GeoKG) quality assessment

Yan Bai, Yunqiang Zhu, Peiyuan Qiu, Gengze Li, Shu Wang, Peng Peng, Yanmin Qi, Jie Yang, Xiaoliang Dai
article en
14 citations

Abstract

High-quality Geographic Knowledge Graphs (GeoKGs) are highly anticipated for their potential to provide reliable semantic support in geographical knowledge reasoning, training Geographic Large Language Models (Geo-LLMs), enabling geographical recommendation, and facilitating various geospatial knowledge-driven tasks. However, there is a lack of a standardized quality assessment methodology and clearly defined evaluative indicators in the field of GeoKGs research. This research uses the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to conduct a systematic review of literature and standards in the field of GeoKG in an effort to fill the gap. First, using the lifecycle theory as a guide, we outline and propose five groups including twenty assessment criteria and their accompanying calculation techniques for evaluating GeoKG quality. Then, expanding on this foundation, we present a streamlined evaluation scheme for GeoKGs that relies on just seven key measures, discussing their applicability, utility, and weight scheme in greater detail. After applying the GeoKG quality framework, we stated three key tasks emerge as priorities: the creation of specialized assessment tools, the formation of worldwide standards, and the building of large-scale, high-quality GeoKGs. We believe this thorough and systematic GeoKG quality assessment technique will help construct high-quality GeoKGs and promote GeoKGs as an engine for geo-intelligence applications including Geospatial Artificial Intelligence (GeoAI) systems, Sustainable Development Goals (SDGs) analyzers, and Virtual Geographic Environments (VGEs) models.

Geo-spatial Information ScienceVol. 28(4)
University of Leeds (GB), University of Nottingham Ningbo China (CN), Chinese Academy of Sciences (CN), Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application (CN), Institute of Geographic Sciences and Natural Resources Research (CN), Shandong Jianzhu University (CN), Tsinghua University (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 0%
Geographic Information Systems Studies
27.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.