The Application and Comparison of Artificial Intelligence LLMs in Psychological Statistical Analysis

With the rapid development of LLMs (LLMs) in the field of natural language processing, there is an increasing interest in their applications within psychological research. This study focuses on three LLMs: OpenAI's GPT-4, Zhipu AI's GLM-4, and Alibaba Cloud's Qwen2.5, to examine their performance and potential value in psychological research. The analysis emphasizes five dimensions of the models' capabilities in handling text data: convenience, lexical statistical abilities, core topic extraction, sentiment analysis, and code generation support. Results indicate that GPT-4 excels in core topic extraction and programming assistance but falls short in convenience for file uploads and sentiment quantification. GLM-4 shows strong performance in sentiment analysis quantification but has limitations in text analysis, code generation, and overall balance. Qwen2.5 demonstrates robust capabilities in text understanding and sentiment classification, highlighting its practicality in processing Chinese text. The findings suggest that LLMs possess significant application potential in psychological research, providing effective support for in-depth cognitive and cultural studies while enhancing the efficiency and accuracy of psychological analysis.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1145/3702879.3702881
Citations
2
Primary Topic
AI and Big Data Applications
Type
article
Field-Weighted Citation Impact
1.56
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Application and Comparison of Artificial Intelligence LLMs in Psychological Statistical Analysis

J. W. Zhang, Xiaopeng Ren
2 citations
AI and Big Data Applications
1.56
article

The Application and Comparison of Artificial Intelligence LLMs in Psychological Statistical Analysis

J. W. Zhang, Xiaopeng Ren
article en
2 citations

Abstract

With the rapid development of LLMs (LLMs) in the field of natural language processing, there is an increasing interest in their applications within psychological research. This study focuses on three LLMs: OpenAI's GPT-4, Zhipu AI's GLM-4, and Alibaba Cloud's Qwen2.5, to examine their performance and potential value in psychological research. The analysis emphasizes five dimensions of the models' capabilities in handling text data: convenience, lexical statistical abilities, core topic extraction, sentiment analysis, and code generation support. Results indicate that GPT-4 excels in core topic extraction and programming assistance but falls short in convenience for file uploads and sentiment quantification. GLM-4 shows strong performance in sentiment analysis quantification but has limitations in text analysis, code generation, and overall balance. Qwen2.5 demonstrates robust capabilities in text understanding and sentiment classification, highlighting its practicality in processing Chinese text. The findings suggest that LLMs possess significant application potential in psychological research, providing effective support for in-depth cognitive and cultural studies while enhancing the efficiency and accuracy of psychological analysis.

Institute of Psychology, Chinese Academy of Sciences (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 12%
AI and Big Data Applications
1.56
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.