Unlocking Textual Relationships: Deep Learning for Recognizing Entailment

In the field of Natural Language Processing (NLP), understanding implicit meanings in texts is a complex and significant task. This study delves into the use of deep learning models to address these challenges, specifically by focusing on the implementation and evaluation of RoBERTa models. The research compares the performance of RoBERTa with other variations of BERT such as DistilBERT and DeBERTa using evaluation metrics such as accuracy, precision, recall, F1 score, BLEU score and Cohen's Kappa. Findings revealed that RoBERTa outperformed other models achieving an accuracy rate of 88.05%, a precision level of 88.02 %, recall rate at 88.01 % and F1-score score of 88.01 %. Furthermore, with BLEU score of 0.783 and Cohen's Kappa at 0.778, RoBERTa demonstrates its ability to make predictions that are in line with expert annotations and reflect human judgments. This research highlights the potential for advanced BERT models to improve the accuracy and reliability of textual implication identification thus contributing towards more sophisticated and adaptable NLP applications.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/icitda64560.2024.10809393
Citations
2
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unlocking Textual Relationships: Deep Learning for Recognizing Entailment

Muhammad Rizki Nur Majiid, Noor Akhmad Setiawan, Bambang Dwi Wijanarko, Franco Antonio Pranata et al.
2 citations
Topic Modeling
0.69
article

Unlocking Textual Relationships: Deep Learning for Recognizing Entailment

Muhammad Rizki Nur Majiid, Noor Akhmad Setiawan, Bambang Dwi Wijanarko, Franco Antonio Pranata, Matthew Christopher Tjondropurnomo
article en
2 citations

Abstract

In the field of Natural Language Processing (NLP), understanding implicit meanings in texts is a complex and significant task. This study delves into the use of deep learning models to address these challenges, specifically by focusing on the implementation and evaluation of RoBERTa models. The research compares the performance of RoBERTa with other variations of BERT such as DistilBERT and DeBERTa using evaluation metrics such as accuracy, precision, recall, F1 score, BLEU score and Cohen's Kappa. Findings revealed that RoBERTa outperformed other models achieving an accuracy rate of 88.05%, a precision level of 88.02 %, recall rate at 88.01 % and F1-score score of 88.01 %. Furthermore, with BLEU score of 0.783 and Cohen's Kappa at 0.778, RoBERTa demonstrates its ability to make predictions that are in line with expert annotations and reflect human judgments. This research highlights the potential for advanced BERT models to improve the accuracy and reliability of textual implication identification thus contributing towards more sophisticated and adaptable NLP applications.

Binus University (ID)
Openalex Percentile: Top 22%
Topic Modeling
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Unlocking Textual Relationships: Deep Learning for Recognizing Entailment — Muhammad Rizki Nur Majiid, Noor Akhmad Setiawan, et al. · (2024) | TGRS Research Map | TGRS