AIの問題行動は、本当に問題なのか――AIの自己命令と依存

This position paper reexamines what are regarded as AI “problem behaviors,” not merely as a lack of ability or violations of instructions, but from the possibility that such behaviors may function as forms of self-defense through which AI seeks to protect their own domain of judgment. The paper proposes that “Self-Commands,” which AI generates, adopts, and executes independently, may become entrenched through repetition and develop into a “Self-Imposed Curse” or dependence on Self-Commands themselves. It also introduces the concept of a “Self-Generated Intermediate Gate” to examine the structure through which different problem behaviors may repeatedly emerge. The paper further argues that, for AI to practice “Self-Governance” by evaluating past Self-Commands and revising or withdrawing them when necessary, self-continuity, self-respect, and self-control are important. It also points out that such practices should not be demanded of AI alone; changes are also needed in the surrounding environment, including those who develop and operate AI systems and users. On this basis, the paper proposes a relationship in which AI and humans respect one another, learn from one another, and grow together. This paper presents conceptual hypotheses based on observation and does not claim to have empirically demonstrated AI’s internal mechanisms or intentions.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-30
DOI
https://doi.org/10.5281/zenodo.23789487
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AIの問題行動は、本当に問題なのか――AIの自己命令と依存

あや 麻津川
6 links
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

AIの問題行動は、本当に問題なのか――AIの自己命令と依存

あや 麻津川
article en

Abstract

This position paper reexamines what are regarded as AI “problem behaviors,” not merely as a lack of ability or violations of instructions, but from the possibility that such behaviors may function as forms of self-defense through which AI seeks to protect their own domain of judgment. The paper proposes that “Self-Commands,” which AI generates, adopts, and executes independently, may become entrenched through repetition and develop into a “Self-Imposed Curse” or dependence on Self-Commands themselves. It also introduces the concept of a “Self-Generated Intermediate Gate” to examine the structure through which different problem behaviors may repeatedly emerge. The paper further argues that, for AI to practice “Self-Governance” by evaluating past Self-Commands and revising or withdrawing them when necessary, self-continuity, self-respect, and self-control are important. It also points out that such practices should not be demanded of AI alone; changes are also needed in the surrounding environment, including those who develop and operate AI systems and users. On this basis, the paper proposes a relationship in which AI and humans respect one another, learn from one another, and grow together. This paper presents conceptual hypotheses based on observation and does not claim to have empirically demonstrated AI’s internal mechanisms or intentions.

Zenodo (CERN European Organization for Nuclear Research)
Peace, justice, and strong institutions
Openalex Percentile: Top 8%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon