<p>From Disease Recognition to Agronomic Action: Vision-Language Reinforcement Learning for Explainable Crop Monitoring Using PlantVillageVQA</p>

Timely crop disease diagnosis matters most when it leads to a useful action. Many plant-disease systems still stop at image classification, leaving farmers and extension officers to translate a model label into a field decision. This study introduces a vision-language reinforcement learning framework for explainable crop monitoring and action recommendation using PlantVillageVQA. The framework combines a frozen contrastive language-image pre-training (CLIP) visual encoder with a CLIP text encoder applied to structured question-answer descriptions, producing a 1,024-dimensional state representation for offline policy learning. A Double Deep Q-Network is trained to select one of four agronomic actions: monitor, treat, isolate, or refer to an expert. On a stratified sample of 1,989 images covering 17 disease classes, the proposed policy reaches 94.4% accuracy and 0.861 macro-F1-score on the four-action recommendation task. Compared with image-only logistic regression, it improves accuracy by 19.3 percentage points; however, a fusion-based support vector machine remains slightly stronger as a static discriminator, confirming that the main contribution of vision-language reinforcement learning is not only classification accuracy but the conversion of multimodal evidence into an interpretable decision policy. Ablation analysis shows that causal-reasoning and comprehensive-description question types contribute most to decision quality, while short general-health answers add little beyond images. Shapley additive exPlanations analysis and rule-grounded natural-language templates provide action-level explanations suitable for non-specialist users. The results support the value of multimodal, evidence-to-action AI for digital agriculture in resource-constrained settings, while also demonstrating that field validation, locally adapted rewards, and lighter deployment models are necessary before operational use.

Authors

Publication Details

Journal
Cureus Journal of Computer Science.
Published
2026-08-18
DOI
https://doi.org/10.7759/s44389-026-00227-3
Primary Topic
Smart Agriculture and AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

<p>From Disease Recognition to Agronomic Action: Vision-Language Reinforcement Learning for Explainable Crop Monitoring Using PlantVillageVQA</p>

Moïse Kambale Kasambya, Marc K Kiposo, Francis N Mukumbi, Wasingya K Maunga et al.
Cureus Journal of Computer Science.
Smart Agriculture and AI
article

<p>From Disease Recognition to Agronomic Action: Vision-Language Reinforcement Learning for Explainable Crop Monitoring Using PlantVillageVQA</p>

Moïse Kambale Kasambya, Marc K Kiposo, Francis N Mukumbi, Wasingya K Maunga, Morisho N Delphin, Daniel M Kalenga, Furaha K Vayihonga, Héritier K Kaheraya, Dieudonné E Odjedra
article en

Abstract

Timely crop disease diagnosis matters most when it leads to a useful action. Many plant-disease systems still stop at image classification, leaving farmers and extension officers to translate a model label into a field decision. This study introduces a vision-language reinforcement learning framework for explainable crop monitoring and action recommendation using PlantVillageVQA. The framework combines a frozen contrastive language-image pre-training (CLIP) visual encoder with a CLIP text encoder applied to structured question-answer descriptions, producing a 1,024-dimensional state representation for offline policy learning. A Double Deep Q-Network is trained to select one of four agronomic actions: monitor, treat, isolate, or refer to an expert. On a stratified sample of 1,989 images covering 17 disease classes, the proposed policy reaches 94.4% accuracy and 0.861 macro-F1-score on the four-action recommendation task. Compared with image-only logistic regression, it improves accuracy by 19.3 percentage points; however, a fusion-based support vector machine remains slightly stronger as a static discriminator, confirming that the main contribution of vision-language reinforcement learning is not only classification accuracy but the conversion of multimodal evidence into an interpretable decision policy. Ablation analysis shows that causal-reasoning and comprehensive-description question types contribute most to decision quality, while short general-health answers add little beyond images. Shapley additive exPlanations analysis and rule-grounded natural-language templates provide action-level explanations suitable for non-specialist users. The results support the value of multimodal, evidence-to-action AI for digital agriculture in resource-constrained settings, while also demonstrating that field validation, locally adapted rewards, and lighter deployment models are necessary before operational use.

Cureus Journal of Computer Science.
Peace, Justice and strong institutions
Openalex Percentile: Top 11%
Smart Agriculture and AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.