Utilizing Natural Language Processing in Chatbots for Integrated Complaint Management Application: A Case Study of PT PLN (Persero) ULP Padalarang
Customer service operations at PT PLN (Persero), Indonesia’s main electricity provider, face considerable challenges in effectively managing customer inquiries. Despite establishing key services through the PLN 123 Contact Center and a chat feature in the PLN mobile app, the current system leads to a backlog of complaints, resulting in delayed responses to customer issues and inadequate resolutions. This research aims to develop a tailored intent classification model for a customer service chatbot within the PLN Mobile application using a transformer-based embedding approach, specifically IndoBERT. A comparative analysis of the transformer model was performed through various experiments focusing on Learning Rate and Optimizer parameters. The results consistently demonstrate the effectiveness of the proposed model, achieving with an accuracy of 93%, precision of 90%, recall of 93%, and an F1 score of 91% and evaluation loss of 0.658680. Thus, the IndoBERT model exhibits strong performance in enhancing customer service chatbots, particularly for general inquiries regarding electricity problems and the PLN Mobile application.
Authors
- Mutiara Auliya Khadija (ORCID: https://orcid.org/0000-0001-7649-5423)
- Lukito Edi Nugroho (ORCID: https://orcid.org/0000-0001-9080-7622)
- Asty Ayu Mutiari
Institutions
- Sebelas Maret University (ID)
- Universitas Gadjah Mada (ID)
Publication Details
- Published
- 2024-12-11
- DOI
- https://doi.org/10.1109/isriti64779.2024.10963544
- Citations
- 1
- Primary Topic
- Information Retrieval and Data Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.78