Evaluating Text Summarization Tools for Educational Applications: A Study of Copilot, ChatGPT, and Quillbot

The aim of this study is to analyze and evaluate the role of text summarization software (TSumSf) in modern education, aiming to improve learning efficiency and save time for learners. The study uses the BERT algorithm to compare the summarization capabilities of tools such as Copilot, QuillBot, and Chat GPT and compare the similarity (Sim) to the original text while providing information on condensation, accuracy, and time-saving ability. The results show that Copilot is suitable for abstract natural science and computer science texts that need to condense the content, while QuillBot is suitable for natural science articles. Chat GPT provides an overview, suitable for journalistic, literary, and technical-scientific texts. The choice of text summarization tools should be based on the specific purpose of use, thereby best supporting learners in accessing and processing information. Following this study, it was found that the summary ratio ranged from Sim = 0.83 to Sim = 0.97. In addition, the study also highlighted the importance of user perception of the usefulness and effectiveness of these tools, along with reliable infrastructure and seamless integration into the educational system.

Authors

Institutions

Publication Details

Published
2025-03-14
DOI
https://doi.org/10.1109/iceit64364.2025.10975903
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating Text Summarization Tools for Educational Applications: A Study of Copilot, ChatGPT, and Quillbot

Vi Loi Truong, Thuong Hong Thi Nguyen, Ngan Tran Huynh Chau
1 citations
Topic Modeling
2.48
article

Evaluating Text Summarization Tools for Educational Applications: A Study of Copilot, ChatGPT, and Quillbot

Vi Loi Truong, Thuong Hong Thi Nguyen, Ngan Tran Huynh Chau
article en
1 citations

Abstract

The aim of this study is to analyze and evaluate the role of text summarization software (TSumSf) in modern education, aiming to improve learning efficiency and save time for learners. The study uses the BERT algorithm to compare the summarization capabilities of tools such as Copilot, QuillBot, and Chat GPT and compare the similarity (Sim) to the original text while providing information on condensation, accuracy, and time-saving ability. The results show that Copilot is suitable for abstract natural science and computer science texts that need to condense the content, while QuillBot is suitable for natural science articles. Chat GPT provides an overview, suitable for journalistic, literary, and technical-scientific texts. The choice of text summarization tools should be based on the specific purpose of use, thereby best supporting learners in accessing and processing information. Following this study, it was found that the summary ratio ranged from Sim = 0.83 to Sim = 0.97. In addition, the study also highlighted the importance of user perception of the usefulness and effectiveness of these tools, along with reliable infrastructure and seamless integration into the educational system.

FPT University (VN)
Quality Education
Openalex Percentile: Top 11%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.