Closed-Set vs. Open-Vocabulary Object Detectors for Urban Architectural Typology Classification: A Comparative Study on Athenian Heritage Buildings

Architectural typology classification plays an important role in large-scale documentation and analysis of urban cultural heritage. Recent advances in computer vision enable automated approaches for detecting and categorizing buildings from street-level imagery, yet the suitability of different detection paradigms for architectural typology analysis remains insufficiently explored. Despite recent advances in computer vision for architectural analysis, no systematic comparative study has evaluated closed-set CNN-based detectors against open-vocabulary vision–language grounding models for urban architectural typology classification. This study presents a comparative evaluation of closed-set convolutional object detectors and open-vocabulary vision–language grounding models for the classification of Athenian architectural typologies. A dataset of 3349 street-view images containing 11,111 annotated building instances was compiled and organized into five typological categories: Neoclassical, Neoclassical-Eclectic, Interwar-Eclectic, Interwar, and Postwar. The experiments compare several YOLO-based detection configurations with Grounding DINO under zero-shot inference, parameter-efficient adaptation (e.g., Kiw Rank Adaptation—LoRA), and full fine-tuning. Results show that supervised YOLO-based models achieve robust detection and classification performance with high localization accuracy and consistent typology discrimination in dense urban scenes. In contrast, open-vocabulary grounding models demonstrate limited reliability in zero-shot settings and require substantial adaptation to approach comparable performance levels. Analysis of confusion patterns further reveals that most classification errors originate from intrinsic architectural similarities between transitional styles rather than from model instability. The findings highlight the advantages of supervised object detection frameworks for scalable urban heritage documentation and provide insights into the current limitations of vision–language models for fine-grained architectural typology classification.

Authors

Institutions

Publication Details

Journal
Heritage
Published
2026-05-21
DOI
https://doi.org/10.3390/heritage9050206
Primary Topic
3D Surveying and Cultural Heritage
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Closed-Set vs. Open-Vocabulary Object Detectors for Urban Architectural Typology Classification: A Comparative Study on Athenian Heritage Buildings

Konstantina Siountri, Konstantinos Filippatos, Christos‐Nikolaos Anagnostopoulos
Heritage
3D Surveying and Cultural Heritage
article

Closed-Set vs. Open-Vocabulary Object Detectors for Urban Architectural Typology Classification: A Comparative Study on Athenian Heritage Buildings

Konstantina Siountri, Konstantinos Filippatos, Christos‐Nikolaos Anagnostopoulos
article en

Abstract

Architectural typology classification plays an important role in large-scale documentation and analysis of urban cultural heritage. Recent advances in computer vision enable automated approaches for detecting and categorizing buildings from street-level imagery, yet the suitability of different detection paradigms for architectural typology analysis remains insufficiently explored. Despite recent advances in computer vision for architectural analysis, no systematic comparative study has evaluated closed-set CNN-based detectors against open-vocabulary vision–language grounding models for urban architectural typology classification. This study presents a comparative evaluation of closed-set convolutional object detectors and open-vocabulary vision–language grounding models for the classification of Athenian architectural typologies. A dataset of 3349 street-view images containing 11,111 annotated building instances was compiled and organized into five typological categories: Neoclassical, Neoclassical-Eclectic, Interwar-Eclectic, Interwar, and Postwar. The experiments compare several YOLO-based detection configurations with Grounding DINO under zero-shot inference, parameter-efficient adaptation (e.g., Kiw Rank Adaptation—LoRA), and full fine-tuning. Results show that supervised YOLO-based models achieve robust detection and classification performance with high localization accuracy and consistent typology discrimination in dense urban scenes. In contrast, open-vocabulary grounding models demonstrate limited reliability in zero-shot settings and require substantial adaptation to approach comparable performance levels. Analysis of confusion patterns further reveals that most classification errors originate from intrinsic architectural similarities between transitional styles rather than from model instability. The findings highlight the advantages of supervised object detection frameworks for scalable urban heritage documentation and provide insights into the current limitations of vision–language models for fine-grained architectural typology classification.

HeritageVol. 9(5)
Hellenic Ministry of Culture and Sports (GR), University of the Aegean (GR)
Sustainable cities and communities
Openalex Percentile: Top 4%
3D Surveying and Cultural Heritage
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.