Energy-Aware Multilingual Vision–Language Models for Drone Smart Sensing
Drone-based smart sensing increasingly relies on Vision–Language Models (VLMs) for real-time scene interpretation, obstacle detection, and autonomous navigation reasoning. Deploying such systems at scale demands not only high perceptual accuracy but also energy efficiency, a critical constraint on battery-powered Unmanned Aerial Vehicle (UAV) platforms, and linguistic flexibility for multinational operational contexts. We present a systematic benchmarking framework that jointly evaluates perception performance and inference energy for five open-source VLMs across thirteen languages spanning six language families, including three low-resource varieties (Arabic, Basque, and Luxembourgish). Using imagery sampled from the Berkeley DeepDrive 10K (BDD10K), each model is evaluated on four sensing tasks of increasing difficulty scored via a sentence-transformer backbone, with energy measured following the AI Energy Score methodology (Wh per 1000 queries) through continuous NVML-based GPU power sampling. Across 65 language–model observations, LLaVA-1.6 achieves the highest perception score (S¯=0.160) while Phi-3-Vision attains the best energy efficiency (66.3 Wh/1000 queries); energy consumption and task accuracy are statistically uncorrelated (Spearman ρ=0.001; p=0.995). A formal UAV inference energy model instantiated for four commercial platforms confirms LLaVA-1.6 as Pareto-optimal on heavy-lift platforms (DJI Matrice 300/350 RTK) and LLaVA-1.5 on the energy-constrained Matrice 30; compact UAVs such as the Mavic 3 Enterprise exceed the budget of all evaluated models at standard query rates. Friedman tests reveal significant cross-language variability in energy demands (χ2=40.43; p=3.5×10−8) and navigation reasoning performance (χ2=13.35; p=0.010). Critically, we document a double penalty for low-resource languages, which simultaneously incur higher inference energy costs and lower task accuracy, with direct implications for equitable multilingual UAV deployments.
Authors
- J. de Curtò (ORCID: https://orcid.org/0000-0002-8334-4719)
- I. de Zarzà (ORCID: https://orcid.org/0000-0002-5844-7871)
- Mauro Liz
- Carlos T. Calafate (ORCID: https://orcid.org/0000-0001-5729-3041)
Institutions
- Boston University (US)
- Universitat Oberta de Catalunya (ES)
- Barcelona Supercomputing Center (ES)
- Luxembourg Institute of Science and Technology (LU)
- Universitat Politècnica de València (ES)
- Universidad Pontificia Comillas (ES)
Publication Details
- Journal
- Drones
- Published
- 2026-05-09
- DOI
- https://doi.org/10.3390/drones10050361
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00