Artificial Intelligence-Powered Intent Classification for Indonesian E-Wallet Customer Service Chatbots
The rapid expansion of e-wallet services in Indonesia has significantly heightened the need for efficient customer service solutions, making chatbots an essential tool for user support. However, many providers continue to rely on rule-based chatbots, resulting in rigid interactions that struggle to meet diverse user needs or handle the linguistic complexities of the Indonesian language. This study addresses these limitations by developing an AI-powered intent classification model specifically tailored for Indonesian e-wallet customer service, aimed at delivering a more accurate, adaptive, and user-centered experience. A custom dataset was created from user comments on social media associated with Indonesia's top e-wallet providers, followed by data pre-processing and clustering using the BERTopic model. To improve interpretability, OpenAI's GPT-4 was employed for label refinement, resulting in enhanced clarity. Various models were tested, including IndoBERT, RoBERTa, and Convolutional Neural Network (CNN) architectures in both 2D and 3D configurations. The highest-performing model combined IndoBERT embeddings with a 3D CNN classifier, achieving an accuracy of 84.30%, precision of 84.33%, recall of 84.30%, and an F1-score of 84.24%. This study contributes a unique Indonesian-specific dataset and demonstrates the potential of AI to transform customer service interactions in Indonesia's e-wallet sector, offering a clear advancement over traditional rule-based approaches.
Authors
- Christopher John Owen (ORCID: https://orcid.org/0000-0002-5982-4667)
- Derwin Suhartono (ORCID: https://orcid.org/0000-0002-3271-5874)
Institutions
- Binus University (ID)
Publication Details
- Published
- 2024-12-17
- DOI
- https://doi.org/10.1109/icicyta64807.2024.10913352
- Primary Topic
- Information Retrieval and Data Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Binus University