Compare the Performance of Current Large Language Models in Terms of System Security

This paper provides a comparative analysis of the systematic security capabilities of four leading large language models: OpenAI's ChatGPT, Meta AIs LLaMA, Moonshot AI's BERT Chat, and Baidu's ERNIE series, including "Wenxin Yiyan." Each model's performance in addressing potential systematic security threats and vulnerabilities was evaluated through a rigorous assessment process. The study found significant differences in the security performance of these models. Specifically, ChatGPT exhibits remarkable resilience in handling confidential information, while LLaMA's advanced contextual understanding enhances its ability to identify and mitigate emerging security risks. BERT Chat stands out due to its strong user privacy protections, and Baidu's ERNIE, particularly "Wenxin Yiyan," provides comprehensive data security through multiple layers of defense. The study highlighted the diversity of security strategies employed by models, while pointing to the need for continued innovation in security measures as large language models develop.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2024-12-12
DOI
https://doi.org/10.54254/2755-2721/2024.18155
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Compare the Performance of Current Large Language Models in Terms of System Security

Xinyi Liu
Applied and Computational Engineering
Privacy-Preserving Technologies in Data
article

Compare the Performance of Current Large Language Models in Terms of System Security

Xinyi Liu
article en

Abstract

This paper provides a comparative analysis of the systematic security capabilities of four leading large language models: OpenAI's ChatGPT, Meta AIs LLaMA, Moonshot AI's BERT Chat, and Baidu's ERNIE series, including "Wenxin Yiyan." Each model's performance in addressing potential systematic security threats and vulnerabilities was evaluated through a rigorous assessment process. The study found significant differences in the security performance of these models. Specifically, ChatGPT exhibits remarkable resilience in handling confidential information, while LLaMA's advanced contextual understanding enhances its ability to identify and mitigate emerging security risks. BERT Chat stands out due to its strong user privacy protections, and Baidu's ERNIE, particularly "Wenxin Yiyan," provides comprehensive data security through multiple layers of defense. The study highlighted the diversity of security strategies employed by models, while pointing to the need for continued innovation in security measures as large language models develop.

Applied and Computational EngineeringVol. 114(1)
Yango University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 79%
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.