A hybrid deep learning and fuzzy logic framework for feature-based evaluation of english Language learners

The integration of artificial intelligence (AI) and natural language processing (NLP) into language learning and assessment has unlocked new possibilities for accurately profiling English language learners (ELLs) and personalizing educational interventions. While previous studies have typically focused on isolated techniques either deep learning, traditional machine learning, or linguistic rule-based models there remains a critical need for comprehensive frameworks that combine the interpretability of rule-based reasoning with the predictive power of advanced AI. Addressing this gap, the present study introduces a novel hybrid methodology for ELL evaluation, integrating both rule mining through fuzzy logic and a state-of-the-art fusion model that integrates DeBERTa, metadata features, and LSTM architectures. This approach employs a hybrid DeBERTa + Metadata + LSTM (DBML) model, where DeBERTa serves as a transformer backbone to extract rich textual embeddings via attention mechanisms, Metadata features capture contextual, cognitive, and demographic learner traits, and LSTM layers are utilized for effective temporal modeling and dense integration. This comprehensive pipeline allows for complex prediction of language proficiency levels, dealing with both unstructured (text response) and structured (behavioral and demographic) data streams. Empirical comparisons against standard machine learning, deep learning, and standalone transformer models demonstrate the superiority of the proposed hybrid approach, achieving a peak accuracy of 93% significantly higher than benchmarked baselines. Furthermore, the study extensively investigates model reliability using statistical significance tests and eXplainable AI (XAI) techniques such as SHAP and DeepSHAP. These analyses not only confirm the model's robustness but also reveal the centrality of linguistic attributes (e.g., Syntax, Cohesion, Vocabulary) in classification, as further substantiated by comprehensive feature ranking including Information Gain, Gain Ratio, Gini Index, and permutation importance based on random forest algorithm for fuzzy rule extraction for top features.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-09-29
DOI
https://doi.org/10.1038/s41598-025-17738-z
Citations
2
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
3.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A hybrid deep learning and fuzzy logic framework for feature-based evaluation of english Language learners

Xuefeng Zhao
2 citations
Scientific Reports
Online Learning and Analytics
3.39
article

A hybrid deep learning and fuzzy logic framework for feature-based evaluation of english Language learners

Xuefeng Zhao
article en
2 citations

Abstract

The integration of artificial intelligence (AI) and natural language processing (NLP) into language learning and assessment has unlocked new possibilities for accurately profiling English language learners (ELLs) and personalizing educational interventions. While previous studies have typically focused on isolated techniques either deep learning, traditional machine learning, or linguistic rule-based models there remains a critical need for comprehensive frameworks that combine the interpretability of rule-based reasoning with the predictive power of advanced AI. Addressing this gap, the present study introduces a novel hybrid methodology for ELL evaluation, integrating both rule mining through fuzzy logic and a state-of-the-art fusion model that integrates DeBERTa, metadata features, and LSTM architectures. This approach employs a hybrid DeBERTa + Metadata + LSTM (DBML) model, where DeBERTa serves as a transformer backbone to extract rich textual embeddings via attention mechanisms, Metadata features capture contextual, cognitive, and demographic learner traits, and LSTM layers are utilized for effective temporal modeling and dense integration. This comprehensive pipeline allows for complex prediction of language proficiency levels, dealing with both unstructured (text response) and structured (behavioral and demographic) data streams. Empirical comparisons against standard machine learning, deep learning, and standalone transformer models demonstrate the superiority of the proposed hybrid approach, achieving a peak accuracy of 93% significantly higher than benchmarked baselines. Furthermore, the study extensively investigates model reliability using statistical significance tests and eXplainable AI (XAI) techniques such as SHAP and DeepSHAP. These analyses not only confirm the model's robustness but also reveal the centrality of linguistic attributes (e.g., Syntax, Cohesion, Vocabulary) in classification, as further substantiated by comprehensive feature ranking including Information Gain, Gain Ratio, Gini Index, and permutation importance based on random forest algorithm for fuzzy rule extraction for top features.

Scientific ReportsVol. 15(1)
Xinjiang Agricultural University (CN), Xinjiang University (CN)
Openalex Percentile: Top 6%
Online Learning and Analytics
3.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.