DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET

In the rapidly evolving intersection of artificial intelligence and educational technology, multi-perspective assessments are transforming language learning. However, much of the existing research focuses on single-dimensional evaluations, often neglecting the potential of a comprehensive, multi-dimensional oral assessment system that addresses acoustic features, content, and language use simultaneously. Few studies have developed such systems based on established language proficiency tests like the General English Profi-ciency Test (GEPT). This study breaks new ground by creating an integrated, multi-dimensional oral assessment system tailored to the Intermediate level of the GEPT Speaking Test, specifically targeting the Picture Description section. We introduce two novel architectural innovations: the first integrates gram-mar error correction using GECToR and ERRANT into the Language Use Module, while the second enhances the Content Module by combining image and question analy-sis through Blip2 and large language models (LLMs). Our system demonstrates robust performance, achieving 71 % ac-curacy on familiar content and 68% accuracy on unfamiliar content.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/o-cocosda64382.2024.10800405
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET

Chung-Chun Wang, Jhen-Ke Lin, Hao-Chien Lu, Berlin Chen
Educational Technology and Assessment
article

DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET

Chung-Chun Wang, Jhen-Ke Lin, Hao-Chien Lu, Berlin Chen
article en

Abstract

In the rapidly evolving intersection of artificial intelligence and educational technology, multi-perspective assessments are transforming language learning. However, much of the existing research focuses on single-dimensional evaluations, often neglecting the potential of a comprehensive, multi-dimensional oral assessment system that addresses acoustic features, content, and language use simultaneously. Few studies have developed such systems based on established language proficiency tests like the General English Profi-ciency Test (GEPT). This study breaks new ground by creating an integrated, multi-dimensional oral assessment system tailored to the Intermediate level of the GEPT Speaking Test, specifically targeting the Picture Description section. We introduce two novel architectural innovations: the first integrates gram-mar error correction using GECToR and ERRANT into the Language Use Module, while the second enhances the Content Module by combining image and question analy-sis through Blip2 and large language models (LLMs). Our system demonstrates robust performance, achieving 71 % ac-curacy on familiar content and 68% accuracy on unfamiliar content.

National Taiwan Normal University (TW)
Quality Education
Openalex Percentile: Top 63%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET — Chung-Chun Wang, Jhen-Ke Lin, et al. · (2024) | TGRS Research Map | TGRS