Transfer learning for multi-class oral epithelial dysplasia grading: architecture, activation, and split-size effects on training convergence and test performance
Oral epithelial dysplasia (OED) is a critical precursor to oral squamous cell carcinoma, making accurate grading vital for timely clinical intervention. This study develops an automated patch-based deep learning framework to improve multi-class OED grading accuracy from histopathological tissue images. Using a locally acquired dataset of 3,777 tissue strips from 94 patients, 256 × 256 images were enhanced using Contrast Limited Adaptive Histogram Equalization (CLAHE) and split into four non-overlapping 128 × 128 patches, generating 15,108 training samples. Seven transfer learning architectures (VGG16, ResNet152V2, InceptionV3, MobileNetV2, Xception, DenseNet201, and InceptionResNetV2) were systematically evaluated using two activation functions (ReLU, Leaky ReLU) across 80:20 and 90:10 data splits. Training convergence, validation performance, and early stopping behavior were tracked across all configurations. Xception with ReLU activation under a 90:10 split achieved the highest held-out test performance, reaching 85.19% classification accuracy and a weighted F1-score of 85.36%, along with top validation accuracy (84.77%). Conversely, VGG16 with Leaky ReLU and InceptionResNetV2 with ReLU (both 90:10 split) suffered complete training collapse. The proposed patch-based transfer learning framework demonstrates strong potential for reliable, automated multi-class OED grading. Additionally, instances of model collapse highlight important optimization instabilities to navigate when fine-tuning deep architectures on histopathological data.
Authors
- Tapabrat Thakuria (ORCID: https://orcid.org/0009-0000-1190-6180)
- Lipi B. Mahanta2
- Taibur Rahman
- Anup Kumar Das
Institutions
- Institute of Advanced Study in Science and Technology (IN)
- Academy of Scientific and Innovative Research (IN)
Publication Details
- Journal
- The Saudi Dental Journal
- Published
- 2026-11-20
- DOI
- https://doi.org/10.1007/s44445-026-00233-0
- Primary Topic
- AI in cancer detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00