An uncertainty-aware evaluation framework based on hierarchical vision transformers for robust cross-domain plant leaf disease classification

Plant leaf disease detection is a critical task in precision agriculture, where reliable diagnosis under real-world conditions is essential for reducing crop losses and supporting timely intervention. Although deep learning models have achieved high classification accuracy, their performance often degrades under domain shift between controlled laboratory datasets and real-field environments, while predictive uncertainty and confidence calibration remain largely unaddressed.This study presents an uncertainty-aware cross-domain evaluation framework based on a Hierarchical Vision Transformer (HViT) for plant leaf disease classification. The framework integrates multi-scale feature learning with Monte Carlo Dropout-based predictive uncertainty estimation and temperature-based calibration to systematically analyze model behavior in terms of accuracy, reliability, and robustness. Experiments were conducted on two complementary datasets: the New Plant Diseases Dataset (controlled conditions) and the PlantDoc dataset (field conditions), enabling bidirectional cross-domain evaluation. Results demonstrate that the proposed framework achieves superior performance, attaining 97.8% accuracy on controlled data and 93.6% on field data, while significantly improving calibration with lower Expected Calibration Error (ECE = 0.032 / 0.041), reduced Negative Log-Likelihood, and lower Brier score compared to baseline CNN and transformer models. Furthermore, the framework exhibits improved robustness under domain shift, with reduced performance degradation and stable uncertainty behavior. Overall, this study highlights the importance of integrating uncertainty estimation and calibration within a hierarchical transformer-based framework, providing a more reliable and deployment-ready solution for real-world agricultural disease diagnosis.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-27
DOI
https://doi.org/10.1038/s41598-026-55107-6
Primary Topic
Smart Agriculture and AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An uncertainty-aware evaluation framework based on hierarchical vision transformers for robust cross-domain plant leaf disease classification

Tripti Shrivastava, Ayush Kumar Agrawal, Abhinav Shukla, Parul Dubey
Scientific Reports
Smart Agriculture and AI
article

An uncertainty-aware evaluation framework based on hierarchical vision transformers for robust cross-domain plant leaf disease classification

Tripti Shrivastava, Ayush Kumar Agrawal, Abhinav Shukla, Parul Dubey
article en

Abstract

Plant leaf disease detection is a critical task in precision agriculture, where reliable diagnosis under real-world conditions is essential for reducing crop losses and supporting timely intervention. Although deep learning models have achieved high classification accuracy, their performance often degrades under domain shift between controlled laboratory datasets and real-field environments, while predictive uncertainty and confidence calibration remain largely unaddressed.This study presents an uncertainty-aware cross-domain evaluation framework based on a Hierarchical Vision Transformer (HViT) for plant leaf disease classification. The framework integrates multi-scale feature learning with Monte Carlo Dropout-based predictive uncertainty estimation and temperature-based calibration to systematically analyze model behavior in terms of accuracy, reliability, and robustness. Experiments were conducted on two complementary datasets: the New Plant Diseases Dataset (controlled conditions) and the PlantDoc dataset (field conditions), enabling bidirectional cross-domain evaluation. Results demonstrate that the proposed framework achieves superior performance, attaining 97.8% accuracy on controlled data and 93.6% on field data, while significantly improving calibration with lower Expected Calibration Error (ECE = 0.032 / 0.041), reduced Negative Log-Likelihood, and lower Brier score compared to baseline CNN and transformer models. Furthermore, the framework exhibits improved robustness under domain shift, with reduced performance degradation and stable uncertainty behavior. Overall, this study highlights the importance of integrating uncertainty estimation and calibration within a hierarchical transformer-based framework, providing a more reliable and deployment-ready solution for real-world agricultural disease diagnosis.

Scientific Reports
Symbiosis International University (IN), Dr. C. V. Raman University (IN)
Openalex Percentile: Top 7%
Smart Agriculture and AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.