A multimodal context-aware AI recommender for smart farming

Agricultural productivity in developing regions is significantly affected by plant diseases and pest infestations, making early detection and timely intervention essential for improving crop yield and food security. This study proposes a multimodal context-aware AI recommendation framework that integrates maize leaf image analysis and environmental conditions to support intelligent agricultural decision-making. The framework combines a deep learning-based image classification model with weather variables, including temperature, humidity, rainfall, and solar radiation, through a multimodal fusion model for maize disease diagnosis. Based on the predicted crop condition, a context-aware recommendation engine integrates rule-based agronomic knowledge with the Qwen2.5:7B large language model to generate reliable and actionable natural-language recommendations for farmers. The generated recommendations are subsequently evaluated using Llama 3.1:8B in a blind LLM-based evaluation framework. Experiments were conducted using maize leaf images from the YEESI Lab dataset and a 61-day environmental dataset from the NASA POWER database, obtained for the geographic coordinates of Morogoro, Tanzania. Three maize conditions were considered: healthy plants, aphid infestation, and maize streak virus infection. The image-based model achieved an accuracy of 91%, while the weather-based model showed lower performance due to overlapping environmental characteristics among disease classes. The proposed multimodal fusion model achieved a classification accuracy of 94%, demonstrating the effectiveness of integrating visual and environmental information for disease diagnosis. The recommendation engine achieved an overall evaluation score of 4.80/5.00 across five quality dimensions—Safety, Technical Accuracy, Relevance, Actionability, and Clarity—indicating that the generated recommendations were agronomically consistent, context-aware, and actionable. The proposed framework provides an end-to-end AI-driven decision-support solution that integrates multimodal disease diagnosis, and context-aware recommendation for precision agriculture.