Are VLMs ready fo critical use cases ? Evaluating zero-shot performance with contextual prompts

This study investigates Vision-Language Models (VLMs) for fire detection tasks, leveraging contextual prompts to assess their performance across various models. Notable results include, the Bunny model, which achieved a 76% F1-score, highlighting its effectiveness. These findings emphasize the impact of prompt engineering on performance while raising key questions about automating prompt optimization and selecting the most suitable VLMs based on task complexity, resource constraints, and real-world applicability.

Publication Details

Journal
ArODES (HES-SO (https://www.hes-so.ch/))
Published
2025-06-20
Primary Topic
Fire Detection and Safety Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Are VLMs ready fo critical use cases ? Evaluating zero-shot performance with contextual prompts

ArODES (HES-SO (https://www.hes-so.ch/))
Fire Detection and Safety Systems
article

Are VLMs ready fo critical use cases ? Evaluating zero-shot performance with contextual prompts

article en

Abstract

This study investigates Vision-Language Models (VLMs) for fire detection tasks, leveraging contextual prompts to assess their performance across various models. Notable results include, the Bunny model, which achieved a 76% F1-score, highlighting its effectiveness. These findings emphasize the impact of prompt engineering on performance while raising key questions about automating prompt optimization and selecting the most suitable VLMs based on task complexity, resource constraints, and real-world applicability.

ArODES (HES-SO (https://www.hes-so.ch/))
Openalex Percentile: Top 45%
Fire Detection and Safety Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Are VLMs ready fo critical use cases ? Evaluating zero-shot performance with contextual prompts · ArODES (HES-SO (https://www.hes-so.ch/)) (2025) | TGRS Research Map | TGRS