The use of LLM to identify goals and objectives from the text of degree thesis using fine-tuning and prompt-engineering methods

This research examines the application of Large Language Models (LLMs) fine-tuned on specially prepared datasets to solve the task of identifying goals and objectives from introductions of student degree theses. Models Qwen2.5, Qwen3, and Gemma3 were considered, each fine-tuned using LoRA and DoRA methods. The obtained results confirm that LLMs have potential for effective analysis of complex structured texts containing both scientific and practice-oriented academic materials. The Qwen3 model fine-tuned using the DoRA method demonstrated the best results in extracting specific semantic fragments from complex structured and voluminous texts.

Authors

Institutions

Publication Details

Published
2025-08-07
DOI
https://doi.org/10.1109/acdsa65407.2025.11165914
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The use of LLM to identify goals and objectives from the text of degree thesis using fine-tuning and prompt-engineering methods

Viacheslav Martsinkevich, Vladislav Tereshchenko, Natig Aminov, Alexey Dukhanov
Educational Technology and Assessment
article

The use of LLM to identify goals and objectives from the text of degree thesis using fine-tuning and prompt-engineering methods

Viacheslav Martsinkevich, Vladislav Tereshchenko, Natig Aminov, Alexey Dukhanov
article en

Abstract

This research examines the application of Large Language Models (LLMs) fine-tuned on specially prepared datasets to solve the task of identifying goals and objectives from introductions of student degree theses. Models Qwen2.5, Qwen3, and Gemma3 were considered, each fine-tuned using LoRA and DoRA methods. The obtained results confirm that LLMs have potential for effective analysis of complex structured texts containing both scientific and practice-oriented academic materials. The Qwen3 model fine-tuned using the DoRA method demonstrated the best results in extracting specific semantic fragments from complex structured and voluminous texts.

ITMO University (RU)
Openalex Percentile: Top 62%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.