Can AI Observe Geographical Space? GVSABench For Evaluating Geo‐Visuospatial Ability of Large Multimodal Models

ABSTRACT This study introduces GVSABench, a comprehensive Geo‐Visuospatial Ability (GVSA) benchmark for evaluating the spatial abilities of multimodal large language models (MLLMs). The benchmark systematically spans intrinsic and extrinsic, static and dynamic, and geographic and non‐geographic dimensions, comprising 851 image‐based tasks. These tasks cover a variety of tasks including spatial visualization, spatial relation reasoning, scene interpretation, spatial orientation and localization, and map‐based problem‐solving. Seven state‐of‐the‐art MLLMs were tested under zero‐shot, zero‐CoT, and one‐shot prompting strategies. Results indicate that overall accuracies remain moderate to low, with significant variability across models, languages, and task types. Prompting strategies yield only limited improvements, underscoring that engineering alone cannot compensate for fundamental deficits in spatial cognition. Moreover, a scale‐separation effect was observed, with distinct performance patterns between geographic and non‐geographic tasks, as well as between small‐ and large‐scale contexts. These findings reveal the incomplete integration of visual, linguistic, and spatial reasoning in current MLLMs. GVSABench offers a reproducible and cognitively grounded framework for advancing future research on robust and human‐aligned spatial intelligence.

Authors

Institutions

Publication Details

Journal
Transactions in GIS
Published
2026-02-01
DOI
https://doi.org/10.1111/tgis.70189
Primary Topic
Spatial Cognition and Navigation
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can AI Observe Geographical Space? GVSABench For Evaluating Geo‐Visuospatial Ability of Large Multimodal Models

Can Liu, Hua Liao, Zhiwei Wei, Weihua Dong
Transactions in GIS
Spatial Cognition and Navigation
article

Can AI Observe Geographical Space? GVSABench For Evaluating Geo‐Visuospatial Ability of Large Multimodal Models

Can Liu, Hua Liao, Zhiwei Wei, Weihua Dong
article en

Abstract

ABSTRACT This study introduces GVSABench, a comprehensive Geo‐Visuospatial Ability (GVSA) benchmark for evaluating the spatial abilities of multimodal large language models (MLLMs). The benchmark systematically spans intrinsic and extrinsic, static and dynamic, and geographic and non‐geographic dimensions, comprising 851 image‐based tasks. These tasks cover a variety of tasks including spatial visualization, spatial relation reasoning, scene interpretation, spatial orientation and localization, and map‐based problem‐solving. Seven state‐of‐the‐art MLLMs were tested under zero‐shot, zero‐CoT, and one‐shot prompting strategies. Results indicate that overall accuracies remain moderate to low, with significant variability across models, languages, and task types. Prompting strategies yield only limited improvements, underscoring that engineering alone cannot compensate for fundamental deficits in spatial cognition. Moreover, a scale‐separation effect was observed, with distinct performance patterns between geographic and non‐geographic tasks, as well as between small‐ and large‐scale contexts. These findings reveal the incomplete integration of visual, linguistic, and spatial reasoning in current MLLMs. GVSABench offers a reproducible and cognitively grounded framework for advancing future research on robust and human‐aligned spatial intelligence.

Transactions in GISVol. 30(1)
Hunan Normal University (CN), Beijing Normal University (CN)
National Natural Science Foundation of China
Quality Education
Openalex Percentile: Top 61%
Spatial Cognition and Navigation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.