Automated Grading of Students’ Short Answers Using Language Models

Methods of assessing student answers using language models are currently being studied by various specialists. The results of automated assessment depend on the subject area and characteristics of the academic discipline. This paper analyzes students’ answers received during a Computer Graphics and Design course. It is proposed to determine the cosine similarity of document vectors obtained using language models and refine the estimates by checking keywords. The results obtained can be used for preliminary assessment of students’ answers and form the basis for further research.

Authors

Institutions

Publication Details

Journal
Automatic Documentation and Mathematical Linguistics
Published
2024-12-01
DOI
https://doi.org/10.3103/s0005105525700177
Citations
2
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated Grading of Students’ Short Answers Using Language Models

Chulpan Minnegalieva, Olga N. Morozova, Ilnur Ilhamovich Kashapov
2 citations
Automatic Documentation and Mathematical Linguistics
Intelligent Tutoring Systems and Adaptive Learning
0.69
article

Automated Grading of Students’ Short Answers Using Language Models

Chulpan Minnegalieva, Olga N. Morozova, Ilnur Ilhamovich Kashapov
article en
2 citations

Abstract

Methods of assessing student answers using language models are currently being studied by various specialists. The results of automated assessment depend on the subject area and characteristics of the academic discipline. This paper analyzes students’ answers received during a Computer Graphics and Design course. It is proposed to determine the cosine similarity of document vectors obtained using language models and refine the estimates by checking keywords. The results obtained can be used for preliminary assessment of students’ answers and form the basis for further research.

Automatic Documentation and Mathematical LinguisticsVol. 58(S3)
Kazan Federal University (RU)
Quality Education
Openalex Percentile: Top 22%
Intelligent Tutoring Systems and Adaptive Learning
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.