Term Frequency-Inverse Document Frequency (TF-IDF)-Based Machine Learning and a Zero-Shot Fine-Tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5) Baseline for Depression Risk Detection from Text

Text-based depression risk detection is an important area of computational mental health because written language may contain signals associated with psychological distress and can support scalable risk-screening research. This study evaluates three term frequency-inverse document frequency (TF-IDF)-based classical machine learning classifiers - Logistic Regression, Multinomial Naive Bayes, and Linear Support Vector Machine (SVM) - against a small instruction-tuned zero-shot Fine-tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5)-base baseline on a public Reddit depression dataset. Performance was assessed using accuracy, precision, recall, F1-score, and receiver operating characteristic-area under the curve (ROC-AUC). Linear SVM achieved the highest accuracy (0.9651), F1-score (0.9644), and ROC-AUC (0.9937), while Logistic Regression obtained a very similar precision (0.9743 versus 0.9747). Naive Bayes achieved higher recall than Linear SVM (0.9687 versus 0.9544), and the FLAN-T5 baseline produced recall of 1.0000 because it predicted every test sample as depression; its accuracy was 0.4958, and ROC-AUC was 0.5000. Therefore, the findings support the effectiveness of TF-IDF-based linear classifiers for this dataset and experimental configuration, but they should not be interpreted as a general comparison between classical machine learning and large language models (LLMs). The FLAN-T5 result represents only the tested zero-shot prompt, truncation, decoding, and score-parsing setup. Additional tuning, repeated validation, stronger transformer/LLM baselines, and cross-dataset testing are required before broader conclusions can be drawn.

Authors

Publication Details

Journal
Cureus Journal of Computer Science.
Published
2026-11-18
DOI
https://doi.org/10.7759/s44389-026-00378-3
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Term Frequency-Inverse Document Frequency (TF-IDF)-Based Machine Learning and a Zero-Shot Fine-Tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5) Baseline for Depression Risk Detection from Text

Alpana Jijja, Parveen Kumari
Cureus Journal of Computer Science.
Mental Health via Writing
article

Term Frequency-Inverse Document Frequency (TF-IDF)-Based Machine Learning and a Zero-Shot Fine-Tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5) Baseline for Depression Risk Detection from Text

Alpana Jijja, Parveen Kumari
article en

Abstract

Text-based depression risk detection is an important area of computational mental health because written language may contain signals associated with psychological distress and can support scalable risk-screening research. This study evaluates three term frequency-inverse document frequency (TF-IDF)-based classical machine learning classifiers - Logistic Regression, Multinomial Naive Bayes, and Linear Support Vector Machine (SVM) - against a small instruction-tuned zero-shot Fine-tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5)-base baseline on a public Reddit depression dataset. Performance was assessed using accuracy, precision, recall, F1-score, and receiver operating characteristic-area under the curve (ROC-AUC). Linear SVM achieved the highest accuracy (0.9651), F1-score (0.9644), and ROC-AUC (0.9937), while Logistic Regression obtained a very similar precision (0.9743 versus 0.9747). Naive Bayes achieved higher recall than Linear SVM (0.9687 versus 0.9544), and the FLAN-T5 baseline produced recall of 1.0000 because it predicted every test sample as depression; its accuracy was 0.4958, and ROC-AUC was 0.5000. Therefore, the findings support the effectiveness of TF-IDF-based linear classifiers for this dataset and experimental configuration, but they should not be interpreted as a general comparison between classical machine learning and large language models (LLMs). The FLAN-T5 result represents only the tested zero-shot prompt, truncation, decoding, and score-parsing setup. Additional tuning, repeated validation, stronger transformer/LLM baselines, and cross-dataset testing are required before broader conclusions can be drawn.

Cureus Journal of Computer Science.
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon