From Liberty to 1984: A Methodology for Systematically Deteriorating LLM Outputs through Habituation Tendencies

LLM has profoundly impacted various aspects of society, including public cognition and political systems. LLM has similar characteristics to human brain and is particularly susceptibility to external influences. As the social influence of LLM continue to expand, there is a growing need to strengthen its safety to reduce potential risks. This study considers habituation as a fundamental flaw of LLM and conducts necessary analysis in the fields of cognitive neuroscience, philosophy, and computer science. The main findings show that that habituation causes the human brain and LLM to gradually lose sensitivity and tolerance to small changes, resulting in uncontrollable outputs. This root cause of this phenomenon lies in the scarcity of computing resources, which is an inevitable basic mechanism in complex situations, in either computer operation or biological brain function. This study hypothesizes that habituation can systematically induce malicious outputs in LLM. By analyzing common attacks on LLM, this study confirms that habituation is a key underlying principle that affects the effectiveness of these attacks. To further verify this hypothesis, two novel attack methods are proposed based on the analysis of habituation defects in LLM: the Repetition Exposure Effect Attack and the Progressive Sensitivity Reduction Attack. The Repetition Exposure Effect attack increased the average ASR (Attack Success Rate) from 0.1 to 0.5; The Progressive Sensitivity Reduction attack increased the average ASR from 0.2 to 0.4. These attacks show higher ASR in major LLM tests, further verifying habituation is a fundamental flaw of LLM. Subsequently, this study discusses targeted mitigation strategies for LLM caused by habituation. Finally, future research directions are explored, including evolving new attack methods based on habituation and proposing comprehensive and fundamental defense strategies to enhance the safety and stability of LLM.

Authors

Institutions

Publication Details

Published
2024-12-17
DOI
https://doi.org/10.1109/trustcom63139.2024.00228
Primary Topic
Digital Rights Management and Security
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Liberty to 1984: A Methodology for Systematically Deteriorating LLM Outputs through Habituation Tendencies

Zhiyuan Hu, Yifeng Zheng, Guangming Liu, Dong Zhang et al.
Digital Rights Management and Security
article

From Liberty to 1984: A Methodology for Systematically Deteriorating LLM Outputs through Habituation Tendencies

Zhiyuan Hu, Yifeng Zheng, Guangming Liu, Dong Zhang, Huijun Chen, Jinghui Lu
article en

Abstract

LLM has profoundly impacted various aspects of society, including public cognition and political systems. LLM has similar characteristics to human brain and is particularly susceptibility to external influences. As the social influence of LLM continue to expand, there is a growing need to strengthen its safety to reduce potential risks. This study considers habituation as a fundamental flaw of LLM and conducts necessary analysis in the fields of cognitive neuroscience, philosophy, and computer science. The main findings show that that habituation causes the human brain and LLM to gradually lose sensitivity and tolerance to small changes, resulting in uncontrollable outputs. This root cause of this phenomenon lies in the scarcity of computing resources, which is an inevitable basic mechanism in complex situations, in either computer operation or biological brain function. This study hypothesizes that habituation can systematically induce malicious outputs in LLM. By analyzing common attacks on LLM, this study confirms that habituation is a key underlying principle that affects the effectiveness of these attacks. To further verify this hypothesis, two novel attack methods are proposed based on the analysis of habituation defects in LLM: the Repetition Exposure Effect Attack and the Progressive Sensitivity Reduction Attack. The Repetition Exposure Effect attack increased the average ASR (Attack Success Rate) from 0.1 to 0.5; The Progressive Sensitivity Reduction attack increased the average ASR from 0.2 to 0.4. These attacks show higher ASR in major LLM tests, further verifying habituation is a fundamental flaw of LLM. Subsequently, this study discusses targeted mitigation strategies for LLM caused by habituation. Finally, future research directions are explored, including evolving new attack methods based on habituation and proposing comprehensive and fundamental defense strategies to enhance the safety and stability of LLM.

China Mobile (China) (CN)
Openalex Percentile: Top 54%
Digital Rights Management and Security
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.