Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia

Toxic chat in online games exposes young players to harassment, while moderation of Indonesian chat is hampered by slang and non-standard spelling. This study compares monolingual IndoBERT and multilingual mBERT for four-class toxicity classification (neutral, violence, racist, harassment) of Indonesian Roblox and Minecraft chat to identify the more suitable model for moderation. Both models were fine-tuned with identical settings on the Indonesian Chat Dataset (10,702 chats) using three seeds, and evaluated with accuracy, macro-averaged precision, recall, F1-score, and McNemar’s test. IndoBERT reached a mean macro F1-score of 0.8541 ± 0.0019 versus 0.8263 ± 0.0090 for mBERT, significant in two of three seeds. Neutral was the hardest class, and IndoBERT let 5.8% of toxic chats pass as neutral versus 8.3% for mBERT. Excluding 106 duplicated test chats did not change the ranking. Under these settings, IndoBERT performed better, although labels lack inter-annotator agreement and data cover two games only.

Authors

Institutions

Publication Details

Journal
Jurnal Manajemen dan Teknologi
Published
2026-11-17
DOI
https://doi.org/10.63447/jmt.v3i2.2196
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia

Rizka Dhini Kurnia, Hardini Novianti, Allsela Meiriza, Idris Sonny et al.
Jurnal Manajemen dan Teknologi
Hate Speech and Cyberbullying Detection
article

Perbandingan IndoBERT dan mBERT Untuk Klasifikasi Toksisitas Pada Chat Roblox dan Minecraft Berbahasa Indonesia

Rizka Dhini Kurnia, Hardini Novianti, Allsela Meiriza, Idris Sonny, Mira Afriani
article en

Abstract

Toxic chat in online games exposes young players to harassment, while moderation of Indonesian chat is hampered by slang and non-standard spelling. This study compares monolingual IndoBERT and multilingual mBERT for four-class toxicity classification (neutral, violence, racist, harassment) of Indonesian Roblox and Minecraft chat to identify the more suitable model for moderation. Both models were fine-tuned with identical settings on the Indonesian Chat Dataset (10,702 chats) using three seeds, and evaluated with accuracy, macro-averaged precision, recall, F1-score, and McNemar’s test. IndoBERT reached a mean macro F1-score of 0.8541 ± 0.0019 versus 0.8263 ± 0.0090 for mBERT, significant in two of three seeds. Neutral was the hardest class, and IndoBERT let 5.8% of toxic chats pass as neutral versus 8.3% for mBERT. Excluding 106 duplicated test chats did not change the ranking. Under these settings, IndoBERT performed better, although labels lack inter-annotator agreement and data cover two games only.

Jurnal Manajemen dan TeknologiVol. 3(2)
Sriwijaya University (ID)
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon