Automated Genre-Aware Article Scoring and Feedback Using Large Language Models

This paper focuses on the development of an advanced intelligent article scoring system that not only assesses the overall quality of written work but also offers detailed feature-based scoring tailored to various article genres. By integrating the pre-trained BERT model with the large language model Chat-GPT, the system gains a deep understanding of both the content and structure of the text, enabling it to provide a thorough evaluation along with targeted suggestions for improvement. Experimental results demonstrate that this system outperforms traditional scoring methods across multiple public datasets, particularly in feature-based assessments, offering a more accurate reflection of the quality of different article types. Moreover, the system generates personalized feedback to assist users in enhancing their writing skills, underscoring the potential and practical value of automated scoring technologies in educational contexts.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/icbaie63306.2024.11116923
Citations
3
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated Genre-Aware Article Scoring and Feedback Using Large Language Models

Zhenhong Zhang, Ruotong Wang, Jiajing Chen, Shuo Wang et al.
3 citations
Natural Language Processing Techniques
1.04
article

Automated Genre-Aware Article Scoring and Feedback Using Large Language Models

Zhenhong Zhang, Ruotong Wang, Jiajing Chen, Shuo Wang, Yuxin Dong, Chihang Wang
article en
3 citations

Abstract

This paper focuses on the development of an advanced intelligent article scoring system that not only assesses the overall quality of written work but also offers detailed feature-based scoring tailored to various article genres. By integrating the pre-trained BERT model with the large language model Chat-GPT, the system gains a deep understanding of both the content and structure of the text, enabling it to provide a thorough evaluation along with targeted suggestions for improvement. Experimental results demonstrate that this system outperforms traditional scoring methods across multiple public datasets, particularly in feature-based assessments, offering a more accurate reflection of the quality of different article types. Moreover, the system generates personalized feedback to assist users in enhancing their writing skills, underscoring the potential and practical value of automated scoring technologies in educational contexts.

Albany State University (US), University of Indianapolis (US), George Washington University (US), University at Albany, State University of New York (US), Wake Forest University (US), Indiana University – Purdue University Indianapolis (US), New York University (US)
Quality Education
Openalex Percentile: Top 17%
Natural Language Processing Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Automated Genre-Aware Article Scoring and Feedback Using Large Language Models — Zhenhong Zhang, Ruotong Wang, et al. · (2024) | TGRS Research Map | TGRS