Knowledge-Enhanced Geospatial QA: Integrating Wikidata Fact Verification with LLMs

Geospatial question answering (QA) challenges large language models (LLMs) in reasoning about geospatial relationships. This paper presents a hybrid framework that integrates LLMs with Wikidata for fact verification and retrieval, enhancing their geospatial reasoning capabilities. The framework generates facts, verifies them against Wikidata, and uses validated knowledge for use in a Retrieval-Augmented Generation (RAG) pipeline. Experimental results demonstrate that this approach outperforms zero-shot prompting for all tested models, including GPT-3.5-turbo-0125, Llama-3-8b, and Qwen-2.5-14b, showcasing its effectiveness in improving geospatial QA accuracy.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI Symposium Series
Published
2025-05-28
DOI
https://doi.org/10.1609/aaaiss.v5i1.35609
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Knowledge-Enhanced Geospatial QA: Integrating Wikidata Fact Verification with LLMs

Pascal Hitzler, Sanaz Saki Norouzi
Proceedings of the AAAI Symposium Series
Semantic Web and Ontologies
article

Knowledge-Enhanced Geospatial QA: Integrating Wikidata Fact Verification with LLMs

Pascal Hitzler, Sanaz Saki Norouzi
article en

Abstract

Geospatial question answering (QA) challenges large language models (LLMs) in reasoning about geospatial relationships. This paper presents a hybrid framework that integrates LLMs with Wikidata for fact verification and retrieval, enhancing their geospatial reasoning capabilities. The framework generates facts, verifies them against Wikidata, and uses validated knowledge for use in a Retrieval-Augmented Generation (RAG) pipeline. Experimental results demonstrate that this approach outperforms zero-shot prompting for all tested models, including GPT-3.5-turbo-0125, Llama-3-8b, and Qwen-2.5-14b, showcasing its effectiveness in improving geospatial QA accuracy.

Proceedings of the AAAI Symposium SeriesVol. 5(1)
Kansas State University (US)
Openalex Percentile: Top 94%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.