Landmark Recognition Beyond Curated Benchmarks: Cross-Domain Evaluation of a Multi-Threshold Selective YOLO11 Ensemble on User-Generated Imagery, with a Zero-Shot Multimodal LLM Baseline

Landmark recognition for smart tourism is usually validated on curated benchmark images. In deployment, however, the classifier must handle user-generated photographs whose viewpoint, lighting, resolution, occlusion, and compression differ sharply from curated data. This paper evaluates a previously published multi-threshold enhancement and selective YOLO11n-cls ensemble under this shift, and provides a preliminary zero-shot comparison of three general-purpose multimodal large language models (MLLMs) on the same task. To measure the shift, we build Samarkand v2-SNS, a 300-image out-of-distribution test set of social-media photographs of 12 Samarkand landmarks, disjoint from the training and validation data. Under the shift, four supervised baselines fall by 12.73–22.08 percentage points to 73–80% accuracy, and their in-distribution ranking does not hold. The selective ensemble degrades least (99.24% to 93.00%, −6.24 points) and outperforms the strongest baseline by 13 points. A capacity-matched ablation shows that most of this robustness comes from enhancement diversity, not from generic ensembling. In a preliminary comparison, zero-shot MLLMs (GPT-5, Claude Sonnet 4.5, Gemini 2.5) reach only 24.81–54.26%, far below deployment needs. The results argue for reporting out-of-distribution accuracy alongside curated benchmarks, and for hybrid systems that pair compact specialised recognisers with MLLM-based interpretation.

Authors

Institutions

Publication Details

Journal
Journal of Imaging
Published
2026-08-21
DOI
https://doi.org/10.3390/jimaging12080397
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Landmark Recognition Beyond Curated Benchmarks: Cross-Domain Evaluation of a Multi-Threshold Selective YOLO11 Ensemble on User-Generated Imagery, with a Zero-Shot Multimodal LLM Baseline

Javokhir Musaev, Abdimumin Alikulov, Ulugbek Hudayberdiev, Adkham Israilov et al.
Journal of Imaging
Multimodal Machine Learning Applications
article

Landmark Recognition Beyond Curated Benchmarks: Cross-Domain Evaluation of a Multi-Threshold Selective YOLO11 Ensemble on User-Generated Imagery, with a Zero-Shot Multimodal LLM Baseline

Javokhir Musaev, Abdimumin Alikulov, Ulugbek Hudayberdiev, Adkham Israilov, Muhiddin Xidirov
article en

Abstract

Landmark recognition for smart tourism is usually validated on curated benchmark images. In deployment, however, the classifier must handle user-generated photographs whose viewpoint, lighting, resolution, occlusion, and compression differ sharply from curated data. This paper evaluates a previously published multi-threshold enhancement and selective YOLO11n-cls ensemble under this shift, and provides a preliminary zero-shot comparison of three general-purpose multimodal large language models (MLLMs) on the same task. To measure the shift, we build Samarkand v2-SNS, a 300-image out-of-distribution test set of social-media photographs of 12 Samarkand landmarks, disjoint from the training and validation data. Under the shift, four supervised baselines fall by 12.73–22.08 percentage points to 73–80% accuracy, and their in-distribution ranking does not hold. The selective ensemble degrades least (99.24% to 93.00%, −6.24 points) and outperforms the strongest baseline by 13 points. A capacity-matched ablation shows that most of this robustness comes from enhancement diversity, not from generic ensembling. In a preliminary comparison, zero-shot MLLMs (GPT-5, Claude Sonnet 4.5, Gemini 2.5) reach only 24.81–54.26%, far below deployment needs. The results argue for reporting out-of-distribution accuracy alongside curated benchmarks, and for hybrid systems that pair compact specialised recognisers with MLLM-based interpretation.

Journal of ImagingVol. 12(8)
Samarkand State University named after Sharof Rashidov (UZ), National Pedagogical University of Uzbekistan named after Nizami (UZ), National University of Uzbekistan (UZ), Yeungnam University (KR)
Decent work and economic growth
Openalex Percentile: Top 12%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.