The Assessment of Body Image Based on Large Language Model

Assessing adolescent body image is crucial for mental health interventions, yet traditional methods suffer from limited dimensional coverage, poor dynamic tracking, and weak ecological validity. To address these gaps, this study proposes a multidimensional evaluation using large language models (LLMs) and compares its criterion validity against a dictionary-based method and expert ratings. We defined four dimensions-perception, positive attitude, negative attitude, behavior-by reviewing the body-image literature and built a validated dictionary through expert ratings and iterative refinement. A four-step prompt-engineering process, incorporating role-playing and other optimization techniques, produced tailored prompts for LLM-based recognition. To validate these tools, we collected self-reported texts and scale scores from 194 university students, performed semantic analyses with Llama-3.1-70B, Qwen-Max, and DeepSeek-R1 using these prompts, and confirmed ecological validity on social media posts. Results indicate that our multidimensional dictionary correlated significantly with expert ratings across all four dimensions (r = 0.515-0.625), providing a solid benchmark. LLM-based assessments then outperformed both the dictionary and human ratings, with zero-shot LLMs achieving r = 0.664 in positive attitude (vs. expert r = 0.657) and DeepSeek-R1 reaching r = 0.722 in perception. Role-playing techniques significantly improved the validity in the perception dimension (Δr = +0.117). Consistency checks revealed that the DeepSeek model reduced error dispersion in extreme score ranges by 48.4% compared to human ratings, with the 95% consistency limits covering the fluctuations of human scores. Incremental validity analysis showed that LLMs could replace human evaluations in the perception dimension (ΔR <sup>2</sup> = 0.220). In ecological validity checks, the Qwen model achieved a correlation of 0.651 in the social media behavior dimension-53.1% higher than the dictionary method. We found that LLMs demonstrated significant advantages in the multidimensional assessment of body image, offering a new intelligent approach to mental health measurement.

Authors

Institutions

Publication Details

Journal
PsyCh Journal
Published
2025-08-30
DOI
https://doi.org/10.1002/pchj.70048
Primary Topic
Traditional Chinese Medicine Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Assessment of Body Image Based on Large Language Model

Nan Zhao, Fumeng Li
PsyCh Journal
Traditional Chinese Medicine Studies
article

The Assessment of Body Image Based on Large Language Model

Nan Zhao, Fumeng Li
article en

Abstract

Assessing adolescent body image is crucial for mental health interventions, yet traditional methods suffer from limited dimensional coverage, poor dynamic tracking, and weak ecological validity. To address these gaps, this study proposes a multidimensional evaluation using large language models (LLMs) and compares its criterion validity against a dictionary-based method and expert ratings. We defined four dimensions-perception, positive attitude, negative attitude, behavior-by reviewing the body-image literature and built a validated dictionary through expert ratings and iterative refinement. A four-step prompt-engineering process, incorporating role-playing and other optimization techniques, produced tailored prompts for LLM-based recognition. To validate these tools, we collected self-reported texts and scale scores from 194 university students, performed semantic analyses with Llama-3.1-70B, Qwen-Max, and DeepSeek-R1 using these prompts, and confirmed ecological validity on social media posts. Results indicate that our multidimensional dictionary correlated significantly with expert ratings across all four dimensions (r = 0.515-0.625), providing a solid benchmark. LLM-based assessments then outperformed both the dictionary and human ratings, with zero-shot LLMs achieving r = 0.664 in positive attitude (vs. expert r = 0.657) and DeepSeek-R1 reaching r = 0.722 in perception. Role-playing techniques significantly improved the validity in the perception dimension (Δr = +0.117). Consistency checks revealed that the DeepSeek model reduced error dispersion in extreme score ranges by 48.4% compared to human ratings, with the 95% consistency limits covering the fluctuations of human scores. Incremental validity analysis showed that LLMs could replace human evaluations in the perception dimension (ΔR <sup>2</sup> = 0.220). In ecological validity checks, the Qwen model achieved a correlation of 0.651 in the social media behavior dimension-53.1% higher than the dictionary method. We found that LLMs demonstrated significant advantages in the multidimensional assessment of body image, offering a new intelligent approach to mental health measurement.

PsyCh JournalVol. 14(5)
China Foreign Affairs University (CN), Institute of Psychology, Chinese Academy of Sciences (CN), Office of International Affairs (US), Institute of Mechanics (CN), Tsinghua University (CN)
Openalex Percentile: Top 64%
Traditional Chinese Medicine Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.