Comparative Analysis of SVM and IndoBERT for Intent Classification in Indonesian Overtime Chatbots

Digital transformation in higher education requires the development of intelligent and adaptive information systems, including services such as overtime submission for university staff. Chatbots offer a promising solution to enhance user interaction with the E-LEMBUR system. However, developing chatbots in academic settings poses challenges, including limited training data, complex overtime policies, and diverse institutional terminology. This study compares two intent classification approaches: Support Vector Machine (SVM), a traditional machine learning method, and IndoBERT, a transformer-based model designed for the Indonesian language. The dataset comprises 250 real user queries from the overtime system at Institut Teknologi Sepuluh Nopember (ITS). Experimental results show IndoBERT achieves 87% accuracy, slightly outperforming SVM at 85%. While IndoBERT offers better accuracy, it demands higher computational resources, presenting a trade-off between performance and efficiency. This study contributes by validating IndoBERT’s effectiveness on a limited dataset, establishing an initial benchmark for intent classification in overtime chatbots, and offering implementation recommendations aligned with university IT infrastructure. These findings lay the groundwork for developing context-aware information systems for staff services in Indonesian higher education.

Authors

Institutions

Publication Details

Journal
Journal of System and Computer Engineering (JSCE)
Published
2025-08-04
DOI
https://doi.org/10.61628/jsce.v6i3.2058
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Analysis of SVM and IndoBERT for Intent Classification in Indonesian Overtime Chatbots

Raden Gunawan Santosa, Adetiya Bagus Nusantara, Syaiful Imron
Journal of System and Computer Engineering (JSCE)
AI in Service Interactions
article

Comparative Analysis of SVM and IndoBERT for Intent Classification in Indonesian Overtime Chatbots

Raden Gunawan Santosa, Adetiya Bagus Nusantara, Syaiful Imron
article en

Abstract

Digital transformation in higher education requires the development of intelligent and adaptive information systems, including services such as overtime submission for university staff. Chatbots offer a promising solution to enhance user interaction with the E-LEMBUR system. However, developing chatbots in academic settings poses challenges, including limited training data, complex overtime policies, and diverse institutional terminology. This study compares two intent classification approaches: Support Vector Machine (SVM), a traditional machine learning method, and IndoBERT, a transformer-based model designed for the Indonesian language. The dataset comprises 250 real user queries from the overtime system at Institut Teknologi Sepuluh Nopember (ITS). Experimental results show IndoBERT achieves 87% accuracy, slightly outperforming SVM at 85%. While IndoBERT offers better accuracy, it demands higher computational resources, presenting a trade-off between performance and efficiency. This study contributes by validating IndoBERT’s effectiveness on a limited dataset, establishing an initial benchmark for intent classification in overtime chatbots, and offering implementation recommendations aligned with university IT infrastructure. These findings lay the groundwork for developing context-aware information systems for staff services in Indonesian higher education.

Journal of System and Computer Engineering (JSCE)Vol. 6(3)
Sepuluh Nopember Institute of Technology (ID), Institut Teknologi dan Bisnis Kalbe (ID)
Institut Teknologi Sepuluh Nopember
Openalex Percentile: Top 88%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.