Human vs AI: Evaluating the Effectiveness of Deep Learning in AI Text Detection
This study looks on the effectiveness of fine-tuned DistilBERT and LSTM models for distinguishing between human-written and AI-generated text. We address the growing demand for reliable AI text identification as an outcome of the potential misuse of large language models (LLMs) in instances related to the transmission of misleading data. This approach combines advantage of the beneficial characteristics of both model, LSTMs’ capacity to extract sequential information from text input, and DistilBERT’s pre-trained interpretation of contextualize associations. We build these models employing a set of labels that includes writings created through machines and people indiscriminately. The evaluation metrics exhibit outstanding achievement, with DistilBERT and LSTM achieving 100% classification accuracy (1.00) of the test sample. By stimulating the ethical use of LLMs while minimizing any adverse effects, the study advances the development of dependable methods that can identify text composed with machines with intelligence.
Authors
- Abubokor Hanip
- Sarv Priya (ORCID: https://orcid.org/0000-0003-2442-1902)
- Mohammad Kamal Uddin (ORCID: https://orcid.org/0009-0007-6438-1526)
- Swagata Roy (ORCID: https://orcid.org/0000-0001-5153-6305)
- Tanjim Mahmud (ORCID: https://orcid.org/0000-0002-1892-0310)
- Taohidur Rahman (ORCID: https://orcid.org/0009-0008-6579-6253)
- Mohammad Shahadat Hossain (ORCID: https://orcid.org/0000-0002-7473-8185)
- Hifju Huma Khanam Redhi
- Muhammad Mizanur Rahman Mizan
Institutions
- Chittagong University of Engineering & Technology (BD)
- International Islamic University Chittagong (BD)
- Rangamati Science and Technology University (BD)
- BGC Trust University Bangladesh (BD)
- University of Chittagong (BD)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/iccit64611.2024.11021749
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00