Development and Validation of Academic Vocabulary Complexity Indicators for Meaning-Centered Approaches in Automated Writing Assessment.

This study designs meaning-based lexical complexity indicators focused on the usage patterns of academic vocabulary in argumentative texts written by native Korean speakers and analyzes the relationship between these indicators and writing assessment elements. The research utilized 1,231 argumentative texts on the same topic from the ‘2023 National Writing Ability Diagnostic System Development Corpus’ by the National Institute of Korean Language. Three indicators were designed and applied: Academic Vocabulary Diversity (SDiv), Level-Weighted Index (SWeight), and Usage Rate (SRate). Quantitative analysis revealed that the level-weighted index and usage rate showed significant positive correlations with assessment scores, with SWeight and SRate demonstrating positive effects on content scores in regression analysis. Qualitative analysis of functional type usage patterns revealed distinct differences between high-scoring and low-scoring groups in type distribution, connection structure, and development patterns. The high-scoring group utilized various types (analysis, justification, causality) in a balanced manner with complex connection structures, while the low-scoring group exhibited linear thinking patterns with excessive dependence on conceptualization. These findings suggest that academic vocabulary-based complexity indicators can contribute to a paradigm shift from form-centered to meaning-centered writing assessment.

Authors

Publication Details

Journal
Korean Semantics
Published
2025-06-30
DOI
https://doi.org/10.19033/sks.2025.6.88.263
Primary Topic
Health Education and Validation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development and Validation of Academic Vocabulary Complexity Indicators for Meaning-Centered Approaches in Automated Writing Assessment.

Na-Hyung Kong
Korean Semantics
Health Education and Validation
article

Development and Validation of Academic Vocabulary Complexity Indicators for Meaning-Centered Approaches in Automated Writing Assessment.

Na-Hyung Kong
article en

Abstract

This study designs meaning-based lexical complexity indicators focused on the usage patterns of academic vocabulary in argumentative texts written by native Korean speakers and analyzes the relationship between these indicators and writing assessment elements. The research utilized 1,231 argumentative texts on the same topic from the ‘2023 National Writing Ability Diagnostic System Development Corpus’ by the National Institute of Korean Language. Three indicators were designed and applied: Academic Vocabulary Diversity (SDiv), Level-Weighted Index (SWeight), and Usage Rate (SRate). Quantitative analysis revealed that the level-weighted index and usage rate showed significant positive correlations with assessment scores, with SWeight and SRate demonstrating positive effects on content scores in regression analysis. Qualitative analysis of functional type usage patterns revealed distinct differences between high-scoring and low-scoring groups in type distribution, connection structure, and development patterns. The high-scoring group utilized various types (analysis, justification, causality) in a balanced manner with complex connection structures, while the low-scoring group exhibited linear thinking patterns with excessive dependence on conceptualization. These findings suggest that academic vocabulary-based complexity indicators can contribute to a paradigm shift from form-centered to meaning-centered writing assessment.

Korean SemanticsVol. 88(0)
Quality Education
Openalex Percentile: Top 79%
Health Education and Validation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.