Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

ChatGPT is an artificial intelligence model, highly proficient in English language and literature. This research explored the functionality of ChatGPT in producing research-oriented texts of the English language and literature in higher education institutions. It consisted of careful analysis of the quality, coherence, and relevance of ChatGPT- produced- content in terms of its capability to develop research topics, abstracts, research methodologies and theoretical- framework -based data analysis, and conclusions. Furthermore, the study focused on its role in academic context by drawing upon a comprehensive analysis of the strengths and limitations of ChatGPT in the research domain. Hence, the analysis consisted of scrutinizing the data for completeness, accuracy, and relevance of the content produced by ChatGPT administrating the CRAAP Test as the designed measure of performance of ChatGPT. Results showed a high proficiency of ChatGPT in originating research ideas and data explication but limiting response in composition of comprehensive abstract writing, research methodologies and principle design, especially when implementing practical implementation of overall research components. Furthermore, the study proposed that researchers should approach AI technology with a critical mindset. Contextually, the incorporation of human linguistic and literary expertise is recommended in utilization of ChatGPT in research studies and academic term papers. These measures will help maintain the quality and integrity of research and academic studies.

Authors

Institutions

Publication Details

Journal
Journal of Education and Social Studies
Published
2024-09-30
DOI
https://doi.org/10.52223/jess.2024.5325
Citations
3
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.36
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

Hina Rafique, Bushra Munawar, Nida Mushtaq Khan
3 citations
Journal of Education and Social Studies
Artificial Intelligence in Healthcare and Education
0.36
article

Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

Hina Rafique, Bushra Munawar, Nida Mushtaq Khan
article en
3 citations

Abstract

ChatGPT is an artificial intelligence model, highly proficient in English language and literature. This research explored the functionality of ChatGPT in producing research-oriented texts of the English language and literature in higher education institutions. It consisted of careful analysis of the quality, coherence, and relevance of ChatGPT- produced- content in terms of its capability to develop research topics, abstracts, research methodologies and theoretical- framework -based data analysis, and conclusions. Furthermore, the study focused on its role in academic context by drawing upon a comprehensive analysis of the strengths and limitations of ChatGPT in the research domain. Hence, the analysis consisted of scrutinizing the data for completeness, accuracy, and relevance of the content produced by ChatGPT administrating the CRAAP Test as the designed measure of performance of ChatGPT. Results showed a high proficiency of ChatGPT in originating research ideas and data explication but limiting response in composition of comprehensive abstract writing, research methodologies and principle design, especially when implementing practical implementation of overall research components. Furthermore, the study proposed that researchers should approach AI technology with a critical mindset. Contextually, the incorporation of human linguistic and literary expertise is recommended in utilization of ChatGPT in research studies and academic term papers. These measures will help maintain the quality and integrity of research and academic studies.

Journal of Education and Social StudiesVol. 5(3)
Southern New Hampshire University (US), GIFT University (PK), University of Oklahoma (US)
Quality Education
Openalex Percentile: Top 34%
Artificial Intelligence in Healthcare and Education
0.36
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content — Hina Rafique, Bushra Munawar, et al. · Journal of Education and Social Studies (2024) | TGRS Research Map | TGRS