The question answering system GeoQA2 and a new benchmark for its evaluation

We present the question answering engine GeoQA2 which is able to answer geospatial questions over the union of knowledge graphs YAGO2 and YAGO2geo. We also present the dataset GeoQuestions1089 which consists of 1089 natural language questions, their corresponding SPARQL or GeoSPARQL queries and their answers over the union of the same knowledge graphs. We use this dataset to compare the effectiveness of GeoQA2 and the system of Hamzei et al. 2022 and make it publicly available to be used by other researchers. Our evaluation shows that although the engine GeoQA2 performs better than the engine of Hamzei et al. 2022, both engines have ample room for improvement in their question answering performance.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Earth Observation and Geoinformation
Published
2024-10-16
DOI
https://doi.org/10.1016/j.jag.2024.104203
Citations
6
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.08

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The question answering system GeoQA2 and a new benchmark for its evaluation

Eleni Tsalapati, Pierre Maret, Manolis Koubarakis, Sergios-Anestis Kefalidis et al.
6 citations
International Journal of Applied Earth Observation and Geoinformation
Topic Modeling
2.08
article

The question answering system GeoQA2 and a new benchmark for its evaluation

Eleni Tsalapati, Pierre Maret, Manolis Koubarakis, Sergios-Anestis Kefalidis, Konstantinos Plas, Dharmen Punjani, Maria-Aggeliki Pollali
article en
6 citations

Abstract

We present the question answering engine GeoQA2 which is able to answer geospatial questions over the union of knowledge graphs YAGO2 and YAGO2geo. We also present the dataset GeoQuestions1089 which consists of 1089 natural language questions, their corresponding SPARQL or GeoSPARQL queries and their answers over the union of the same knowledge graphs. We use this dataset to compare the effectiveness of GeoQA2 and the system of Hamzei et al. 2022 and make it publicly available to be used by other researchers. Our evaluation shows that although the engine GeoQA2 performs better than the engine of Hamzei et al. 2022, both engines have ample room for improvement in their question answering performance.

International Journal of Applied Earth Observation and GeoinformationVol. 134
Centre National de la Recherche Scientifique (FR), National and Kapodistrian University of Athens (GR), Laboratoire Hubert Curien (FR), Université Jean Monnet (FR)
European Space Agency, European Commission, Hellenic Foundation for Research and Innovation
Climate action
Openalex Percentile: Top 11%
Topic Modeling
2.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.