Unlocking Textual Relationships: Deep Learning for Recognizing Entailment
In the field of Natural Language Processing (NLP), understanding implicit meanings in texts is a complex and significant task. This study delves into the use of deep learning models to address these challenges, specifically by focusing on the implementation and evaluation of RoBERTa models. The research compares the performance of RoBERTa with other variations of BERT such as DistilBERT and DeBERTa using evaluation metrics such as accuracy, precision, recall, F1 score, BLEU score and Cohen's Kappa. Findings revealed that RoBERTa outperformed other models achieving an accuracy rate of 88.05%, a precision level of 88.02 %, recall rate at 88.01 % and F1-score score of 88.01 %. Furthermore, with BLEU score of 0.783 and Cohen's Kappa at 0.778, RoBERTa demonstrates its ability to make predictions that are in line with expert annotations and reflect human judgments. This research highlights the potential for advanced BERT models to improve the accuracy and reliability of textual implication identification thus contributing towards more sophisticated and adaptable NLP applications.
Authors
- Muhammad Rizki Nur Majiid (ORCID: https://orcid.org/0000-0002-0198-510X)
- Noor Akhmad Setiawan (ORCID: https://orcid.org/0000-0002-5631-1073)
- Bambang Dwi Wijanarko (ORCID: https://orcid.org/0000-0003-2941-148X)
- Franco Antonio Pranata
- Matthew Christopher Tjondropurnomo
Institutions
- Binus University (ID)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/icitda64560.2024.10809393
- Citations
- 2
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.69