LLMs for Document-Level Text Simplification in Turkish Foreign Language Learning

This study presents the first investigation into the use of large language models (LLMs) for document-level text simplification targeting Turkish foreign language learning. ChatGPT-40 is utilized to simplify six Turkish stories to A1, A2, and B1 proficiency levels and evaluated on a parallel corpus ( i.e., these stories and their simplified versions at A1, A2, and B1 proficiency levels). The model is prompted with specific simplification rules and examples for these rules. We evaluate the performance using multiple metrics including BLEU, SARI, D-SARI, and BERTScore. Our results show that ChatGPT-40 can generate simplified texts comparable inlength and content to human-simplified references. This research addresses the scarcity of reading materials for Turkish learners, a challenge that many other languages also face. It demonstrates the potential of LLMs in producing level-appropriate simplified texts, opening new avenues for automated text simplification in language education.

Authors

Institutions

Publication Details

Published
2024-10-26
DOI
https://doi.org/10.1109/ubmk63289.2024.10773476
Primary Topic
Text Readability and Simplification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLMs for Document-Level Text Simplification in Turkish Foreign Language Learning

Gülşen Eryiğit, Fatih Bektaş, Kutay Arda Dinç
Text Readability and Simplification
article

LLMs for Document-Level Text Simplification in Turkish Foreign Language Learning

Gülşen Eryiğit, Fatih Bektaş, Kutay Arda Dinç
article en

Abstract

This study presents the first investigation into the use of large language models (LLMs) for document-level text simplification targeting Turkish foreign language learning. ChatGPT-40 is utilized to simplify six Turkish stories to A1, A2, and B1 proficiency levels and evaluated on a parallel corpus ( i.e., these stories and their simplified versions at A1, A2, and B1 proficiency levels). The model is prompted with specific simplification rules and examples for these rules. We evaluate the performance using multiple metrics including BLEU, SARI, D-SARI, and BERTScore. Our results show that ChatGPT-40 can generate simplified texts comparable inlength and content to human-simplified references. This research addresses the scarcity of reading materials for Turkish learners, a challenge that many other languages also face. It demonstrates the potential of LLMs in producing level-appropriate simplified texts, opening new avenues for automated text simplification in language education.

Istanbul Technical University (TR)
Quality Education
Openalex Percentile: Top 79%
Text Readability and Simplification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.