Comparative Study on the Performance of LLM-based Psychological Counseling Chatbots via Prompt Engineering Techniques
Recent advancements in large language models (LLMs) have opened new avenues in psychological counseling. This study leverages LLMs to develop chatbots capable of conducting empathetic and personalized counseling sessions by applying various prompt engineering techniques, including zero-shot, few-shot, meta-learning, Chain of Thought, and our newly developed Empathetic Meta-Chain (EMC) method. The EMC method demonstrated superior performance in empathy, response accuracy, interaction continuity, fluency, and understanding, as confirmed by expert evaluations. By integrating advanced empathetic strategies, the EMC chatbot significantly enhances its ability to support users' mental well-being through natural and engaging counseling interactions. These findings highlight the potential of LLM-based counseling chatbots to serve as effective tools in mental health support.
Authors
- Min Jhon (ORCID: https://orcid.org/0000-0002-0408-768X)
- Eunkyoung Jeon
- D.H. Kim
- Sehwan Moon (ORCID: https://orcid.org/0000-0002-4337-0138)
- Jeong Eun Kim (ORCID: https://orcid.org/0000-0001-9766-1531)
- Aram Lee (ORCID: https://orcid.org/0000-0002-9669-2894)
- Ju-Wan Kim
- Kiwon Park
Institutions
- Electronics and Telecommunications Research Institute (KR)
- Chonnam National University Hospital (KR)
- Chonnam National University Hwasun Hospital (KR)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/bibm62325.2024.10822158
- Citations
- 1
- Primary Topic
- Diverse Approaches in Healthcare and Education Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.54
Funders
- Electronics and Telecommunications Research Institute