A data-driven machine learning framework for predicting total agricultural food grain yield

India's agricultural sector is experiencing significant shifts due to climate variability, evolving farming practices, and changing crop patterns. While previous studies have explored crop yield prediction using machine learning commonly adopt image-based Machine learning techniques, many relied on manual hyperparameter tuning and rarely applied these techniques to decision tree based algorithms, limiting reproducibility and optimization. To address this gap, our study presents a consistent, data-driven approach using automated hyperparameter configuration and a moderate-scale, publicly available dataset from the Reserve Bank of India (1967–2024), covering key crops such as Groundnut, Rapeseed, Mustard, Soybean, Coffee, Sugarcane, and Tea. Four ensemble models - Gradient Boost, XGBoost, LightGBM, and CatBoost are used to predict total food grain yield. The model pipeline incorporates five-fold cross-validation, GridSearchCV for hyperparameter tuning, early stopping to prevent overfitting, and SHapley Additive exPlanations(SHAP) for interpretability. Model performance is evaluated using Mean Error (ME), Mean Absolute Error (MAE), Mean Percentage Error (MPE), Root Mean Squared Error (RMSE), Mean Squared Error (MSE), and Coefficient of Determination (R 2 ). Gradient Boost achieved the highest accuracy, followed by CatBoost, XGBoost, and LightGBM. The results demonstrate the reliability and scalability of ensemble models and provide a strong foundation for future integration of geographic and climatic variables into yield forecasting systems. • An ensemble ML framework predicts India's total food grain yield. • Uses GridSearchCV + 5-fold CV and early stopping to prevent overfitting. • Gradient Boost achieves the best test accuracy (R 2 0.955, RMSE 1.478). • SHAP reveals Coffee and Rapeseed & Mustard as key yield drivers. • Scalable, reliable framework ready to integrate climate and geography.

Authors

Institutions

Publication Details

Journal
Results in Engineering
Published
2025-09-01
DOI
https://doi.org/10.1016/j.rineng.2025.106790
Citations
1
Primary Topic
Smart Agriculture and AI
Type
article
Field-Weighted Citation Impact
1.75
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A data-driven machine learning framework for predicting total agricultural food grain yield

S. Nirmaladevi, S. Jagatheswari
1 citations
Results in Engineering
Smart Agriculture and AI
1.75
article

A data-driven machine learning framework for predicting total agricultural food grain yield

S. Nirmaladevi, S. Jagatheswari
article en
1 citations

Abstract

India's agricultural sector is experiencing significant shifts due to climate variability, evolving farming practices, and changing crop patterns. While previous studies have explored crop yield prediction using machine learning commonly adopt image-based Machine learning techniques, many relied on manual hyperparameter tuning and rarely applied these techniques to decision tree based algorithms, limiting reproducibility and optimization. To address this gap, our study presents a consistent, data-driven approach using automated hyperparameter configuration and a moderate-scale, publicly available dataset from the Reserve Bank of India (1967–2024), covering key crops such as Groundnut, Rapeseed, Mustard, Soybean, Coffee, Sugarcane, and Tea. Four ensemble models - Gradient Boost, XGBoost, LightGBM, and CatBoost are used to predict total food grain yield. The model pipeline incorporates five-fold cross-validation, GridSearchCV for hyperparameter tuning, early stopping to prevent overfitting, and SHapley Additive exPlanations(SHAP) for interpretability. Model performance is evaluated using Mean Error (ME), Mean Absolute Error (MAE), Mean Percentage Error (MPE), Root Mean Squared Error (RMSE), Mean Squared Error (MSE), and Coefficient of Determination (R 2 ). Gradient Boost achieved the highest accuracy, followed by CatBoost, XGBoost, and LightGBM. The results demonstrate the reliability and scalability of ensemble models and provide a strong foundation for future integration of geographic and climatic variables into yield forecasting systems. • An ensemble ML framework predicts India's total food grain yield. • Uses GridSearchCV + 5-fold CV and early stopping to prevent overfitting. • Gradient Boost achieves the best test accuracy (R 2 0.955, RMSE 1.478). • SHAP reveals Coffee and Rapeseed & Mustard as key yield drivers. • Scalable, reliable framework ready to integrate climate and geography.

Results in EngineeringVol. 27
Vellore Institute of Technology University (IN)
Openalex Percentile: Top 13%
Smart Agriculture and AI
1.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A data-driven machine learning framework for predicting total agricultural food grain yield — S. Nirmaladevi, S. Jagatheswari · Results in Engineering (2025) | TGRS Research Map | TGRS