Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation

The detection of mental health problems from social media and the interpretation of these results have been extensively explored.Research has shown that incorporating clinical symptom information into a model enhances domain expertise, improving its detection and interpretation performance.While large language models (LLMs) are shown to be effective for generating explanatory rationales in mental health detection, their substantially large parameter size and high computational cost limit their practicality.Reasoning distillation transfers this ability to smaller language models (SLMs), but inconsistencies in the relevance and domain alignment of LLM-generated rationales pose a challenge.This paper investigates how rationale quality impacts SLM performance in mental health detection and explanation generation.We hypothesize that ensuring high-quality and domain-relevant rationales enhances the distillation.To this end, we propose a framework that selects rationales based on their alignment with expert clinical reasoning.Experiments show that our quality-focused approach significantly enhances SLM performance in both mental disorder detection and rationale generation.This work highlights the importance of rationale quality and offers an insightful framework for knowledge transfer in mental health applications.The implementation code and dataset are publicly available 1 .

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1119
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation

Sukmin Cho, Hoyun Song, Huije Lee, Chung Ho Ko et al.
Intelligent Tutoring Systems and Adaptive Learning
article

Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation

Sukmin Cho, Hoyun Song, Huije Lee, Chung Ho Ko, Jisu Shin, Jong Cheol Park
article en

Abstract

The detection of mental health problems from social media and the interpretation of these results have been extensively explored.Research has shown that incorporating clinical symptom information into a model enhances domain expertise, improving its detection and interpretation performance.While large language models (LLMs) are shown to be effective for generating explanatory rationales in mental health detection, their substantially large parameter size and high computational cost limit their practicality.Reasoning distillation transfers this ability to smaller language models (SLMs), but inconsistencies in the relevance and domain alignment of LLM-generated rationales pose a challenge.This paper investigates how rationale quality impacts SLM performance in mental health detection and explanation generation.We hypothesize that ensuring high-quality and domain-relevant rationales enhances the distillation.To this end, we propose a framework that selects rationales based on their alignment with expert clinical reasoning.Experiments show that our quality-focused approach significantly enhances SLM performance in both mental disorder detection and rationale generation.This work highlights the importance of rationale quality and offers an insightful framework for knowledge transfer in mental health applications.The implementation code and dataset are publicly available 1 .

Korea Advanced Institute of Science and Technology (KR)
National Research Foundation, National Research Foundation of Korea, Ministry of Science and ICT, South Korea
Openalex Percentile: Top 90%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.