Multimodal ai in smart agriculture for crop disease detection
Crop diseases reduce agricultural productivity and can cause substantial economic losses when symptoms are identified late. Image-based deep learning has improved automated disease recognition, but a leaf image alone may not explain the environmental conditions that contribute to disease development. This paper presents a literature-grounded conceptual framework for multimodal artificial intelligence (AI) in smart agriculture, combining crop images with sensor readings, weather information, soil measurements, and—where available—remote-sensing data. The framework is primarily motivated by Shrotriya et al.’s CNN–RNN ensemble approach for multimodal cotton plant disease detection, which combines spatial image features and temporal environmental patterns. A convolutional neural network (CNN) or vision transformer extracts visual symptoms, while a recurrent neural network (RNN/LSTM) models sequential measurements. Encoded modalities are aligned and fused before disease classification and optional severity estimation. The proposed pipeline also includes confidence reporting, explainable output, and farmer-oriented alerts. Related research on remote-sensing analysis, energy-efficient AI, integrated soil and irrigation recommendations, and AIoT data management informs the wider system design. This is a proposed framework and literature synthesis, not a report of a newly conducted experiment; therefore, no original accuracy result is claimed. The paper discusses the methodology, evaluation plan, limitations, and opportunities for low-cost deployment. Keywords: Multimodal AI, crop disease detection, CNN, RNN, ensemble learning, smart agriculture
Authors
- sayambar pratiksha sayambar pratiksha
Institutions
- Shivnagar Vidya Prasarak Mandal Institute of Technology and Engineering (IN)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-10-28
- DOI
- https://doi.org/10.5281/zenodo.23724506
- Primary Topic
- Smart Agriculture and AI
- Type
- preprint