Trustworthy Evaluation of Vision–Language Models for UAV Power-Line Inspection: A Resolution- and Parity-Controlled Benchmark

Vision–language models (VLMs) are often reported to outperform vision-only backbones for UAV power-line inspection. We examine that claim using ElecVQA-Bench, a 56,972-item resource derived from InsPLAD, and an audit of partition, evaluated items, label space, replication, input resolution, and side information. The original split has substantial source-photograph dependence and is used for paired diagnostic comparisons. Reported tower-disjoint retraining provides a limited check on new-tower performance within the same source dataset. On the original binary task, no difference is detected by a paired item-level test between the selected Swin and Qwen runs; this does not establish equivalence. Fine-grained results change with resolution, prompt information, class support, and seed. A 14-tower, three-seed comparison changes direction across seeds, and classes represented by only a few items substantially affect macro recall. The contribution is a reproducible task representation and reporting protocol for examining these dependencies, rather than a general ranking of model families or evidence of end-to-end UAV deployment.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-10-30
DOI
https://doi.org/10.3390/electronics15215049
Primary Topic
Power Line Inspection Robots
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Trustworthy Evaluation of Vision–Language Models for UAV Power-Line Inspection: A Resolution- and Parity-Controlled Benchmark

Peiyu Yi, Siyu Xiang, Linghao Zhang, Junwei Kuang
2 links
Electronics
Power Line Inspection Robots
article

Trustworthy Evaluation of Vision–Language Models for UAV Power-Line Inspection: A Resolution- and Parity-Controlled Benchmark

Peiyu Yi, Siyu Xiang, Linghao Zhang, Junwei Kuang
article en

Abstract

Vision–language models (VLMs) are often reported to outperform vision-only backbones for UAV power-line inspection. We examine that claim using ElecVQA-Bench, a 56,972-item resource derived from InsPLAD, and an audit of partition, evaluated items, label space, replication, input resolution, and side information. The original split has substantial source-photograph dependence and is used for paired diagnostic comparisons. Reported tower-disjoint retraining provides a limited check on new-tower performance within the same source dataset. On the original binary task, no difference is detected by a paired item-level test between the selected Swin and Qwen runs; this does not establish equivalence. Fine-grained results change with resolution, prompt information, class support, and seed. A 14-tower, three-seed comparison changes direction across seeds, and classes represented by only a few items substantially affect macro recall. The contribution is a reproducible task representation and reporting protocol for examining these dependencies, rather than a general ranking of model families or evidence of end-to-end UAV deployment.

ElectronicsVol. 15(21)
State Grid Sichuan Electric Power Corporation (China) (CN)
Openalex Percentile: Top 23%
Power Line Inspection Robots
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon