Adaptive Testing with Machine Learning: Customizing English Proficiency Assessments Based on Learner Performance

The implementation of adaptive testing for English proficiency assessments using deep reinforcement learning (DRL) to customize evaluations based on learner performance. The dataset utilized is Classification of English Learner Proficiency, consists of essays ranging from 20 to 300 words, categorized into six Common European Framework of Reference (CEFR) levels: A1, A2, B1, B2, C1, and C2. The research emphasizes a thorough data preprocessing phase, which includes text cleaning and normalization to enhance data quality, followed by feature extraction and tokenization to prepare the textual data for analysis. The core of the study presents a proposed adaptive testing method that leverages a DRL agent to optimize question selection, adjusting the difficulty based on real-time learner performance metrics such as accuracy and response time. This adaptive approach not only personalizes the assessment experience but also maintains learner engagement by presenting appropriately challenging content. The evaluation of the proposed system involves comparative studies against traditional testing methods to assess improvements in learner outcomes and satisfaction. Initial findings indicate that the DRL-driven adaptive testing framework significantly enhances the accuracy of proficiency level predictions while reducing assessment time. Key evaluation metrics demonstrate strong performance, with a precision of 0.92, recall of 0.95, an F1-score of 0.90, and overall accuracy reaching 96%. This research highlights the potential of integrating advanced machine learning techniques in language education, paving the way for more responsive and individualized assessment methodologies.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/ccis63231.2024.10931968
Citations
2
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
1.56
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Testing with Machine Learning: Customizing English Proficiency Assessments Based on Learner Performance

K. Thiyagarajan, M. Mythili, B Lavanya, S Prema et al.
2 citations
Educational Technology and Assessment
1.56
article

Adaptive Testing with Machine Learning: Customizing English Proficiency Assessments Based on Learner Performance

K. Thiyagarajan, M. Mythili, B Lavanya, S Prema, J Naga Madhuri, Bhuvaneswari Pagidipati
article en
2 citations

Abstract

The implementation of adaptive testing for English proficiency assessments using deep reinforcement learning (DRL) to customize evaluations based on learner performance. The dataset utilized is Classification of English Learner Proficiency, consists of essays ranging from 20 to 300 words, categorized into six Common European Framework of Reference (CEFR) levels: A1, A2, B1, B2, C1, and C2. The research emphasizes a thorough data preprocessing phase, which includes text cleaning and normalization to enhance data quality, followed by feature extraction and tokenization to prepare the textual data for analysis. The core of the study presents a proposed adaptive testing method that leverages a DRL agent to optimize question selection, adjusting the difficulty based on real-time learner performance metrics such as accuracy and response time. This adaptive approach not only personalizes the assessment experience but also maintains learner engagement by presenting appropriately challenging content. The evaluation of the proposed system involves comparative studies against traditional testing methods to assess improvements in learner outcomes and satisfaction. Initial findings indicate that the DRL-driven adaptive testing framework significantly enhances the accuracy of proficiency level predictions while reducing assessment time. Key evaluation metrics demonstrate strong performance, with a precision of 0.92, recall of 0.95, an F1-score of 0.90, and overall accuracy reaching 96%. This research highlights the potential of integrating advanced machine learning techniques in language education, paving the way for more responsive and individualized assessment methodologies.

Siddhartha Medical College (IN), Fidelity Investments (United States) (US)
Quality Education
Openalex Percentile: Top 11%
Educational Technology and Assessment
1.56
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adaptive Testing with Machine Learning: Customizing English Proficiency Assessments Based on Learner Performance — K. Thiyagarajan, M. Mythili, et al. · (2024) | TGRS Research Map | TGRS