Implementation of Natural Language Processing (NLP) in Developing a Chatbot Application for Classical Islamic Text Learning at Pesantren El-Huda El-Islamy

El-Huda El-Islamy Islamic Boarding School is an Islamic educational institution that aims to mould students into competent and noble religious preachers. This institution focuses on learning and deep understanding of Islamic teachings, including the study of classical books such as the Yellow Book of Fathul Qorib. This research aims to develop and evaluate an Android-based chatbot application that uses the BERT model to help the learning process of the Yellow Book of Fathul Qorib at El-Huda Islamic Boarding School. In this research, the BERT model is integrated into the chatbot application to understand and respond to user questions appropriately. Testing was done by asking 25 questions to the chatbot, which successfully answered 11 questions with a success rate of 44%. Evaluation of the model performance using confusion matrix showed that the chatbot had 90% accuracy, 87% precision, 87% recall, and 86% F1-score. These results show that the chatbot has not been able to provide relevant and accurate responses, and recognise most of the questions asked. This research concludes that this chatbot application is not yet an effective tool to support the learning process at El-Huda Islamic Boarding School