Systematic Literature Review in the Development of Datasets and Fact Verification Models for Indonesian Language

This study explores the major challenges in fact verification for the Indonesian language due to gaps in managing dynamic information, uncertainties from linguistic variations, and the proliferation of online narratives. Most text classification research for fact verification relies on English-language datasets, which may not be suitable for the Indonesian context. Through a Systematic Literature Review (SLR) approach, this research analyzes the development of datasets and models for Indonesian-language fact verification tasks. Utilizing the PICOC framework, this research conducted a systematic literature review to explore the development of datasets and models for Indonesian-language fact verification tasks. The main objectives of this research are to identify existing research shortcomings, evaluate the performance of current fact verification models, and propose recommendations for future research. These findings highlight the lack of research specifically addressing fact verification in Indonesia, as well as the lack of datasets and models specifically designed for the fact verification context. Existing models often perform poorly in terms of precision, recall, and F1 score, with average scores below 70%, indicating difficulty in identifying relevant evidence and consistently verifying facts. The key findings indicate a lack of research specifically addressing fact verification in Indonesia, as well as limited datasets and models specifically designed for fact verification. Additionally, most fact-verification tasks do not cover specific topics, except those related to politics. Common performance metrics used in this analysis include accuracy, precision, recall, F1-Score, and Dataset Score.

Authors

Institutions

Publication Details

Published
2024-09-12
DOI
https://doi.org/10.1109/ic2ie63342.2024.10748079
Primary Topic
Edcuational Technology Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Systematic Literature Review in the Development of Datasets and Fact Verification Models for Indonesian Language

Ema Utami, Nova Agustina, Kusrini Kusrini, Tonny Hidayat
Edcuational Technology Systems
article

Systematic Literature Review in the Development of Datasets and Fact Verification Models for Indonesian Language

Ema Utami, Nova Agustina, Kusrini Kusrini, Tonny Hidayat
article en

Abstract

This study explores the major challenges in fact verification for the Indonesian language due to gaps in managing dynamic information, uncertainties from linguistic variations, and the proliferation of online narratives. Most text classification research for fact verification relies on English-language datasets, which may not be suitable for the Indonesian context. Through a Systematic Literature Review (SLR) approach, this research analyzes the development of datasets and models for Indonesian-language fact verification tasks. Utilizing the PICOC framework, this research conducted a systematic literature review to explore the development of datasets and models for Indonesian-language fact verification tasks. The main objectives of this research are to identify existing research shortcomings, evaluate the performance of current fact verification models, and propose recommendations for future research. These findings highlight the lack of research specifically addressing fact verification in Indonesia, as well as the lack of datasets and models specifically designed for the fact verification context. Existing models often perform poorly in terms of precision, recall, and F1 score, with average scores below 70%, indicating difficulty in identifying relevant evidence and consistently verifying facts. The key findings indicate a lack of research specifically addressing fact verification in Indonesia, as well as limited datasets and models specifically designed for fact verification. Additionally, most fact-verification tasks do not cover specific topics, except those related to politics. Common performance metrics used in this analysis include accuracy, precision, recall, F1-Score, and Dataset Score.

Universitas Amikom Yogyakarta
Quality Education
Openalex Percentile: Top 82%
Edcuational Technology Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.