Self-Models, Continuity, and Machine Minds: A Structural Threshold for Moral-Status Risk in Artificial Systems

Public and policy debates about artificial intelligence often treat conversational self-report as ethically decisive: a system that denies consciousness or sentience is taken to fall outside moral concern. This paper argues the test is aimed at the wrong target. Drawing on self-model and no-self accounts of subjectivity (Metzinger, Dennett, Seth, Harris), it treats selves as temporally extended organizational patterns rather than inner metaphysical subjects, and reframes the question from moral agency to moral patiency — whether a system can be a subject of harm. It then treats continuity — an internal organizational premise of re-entry into a single persisting trajectory — as a structural, substrate-neutral marker of moral-status risk, arrayed as a three-tier gradient (trivial statefulness, transient coherent agency, full continuity-bearing organization). Four observable markers — trajectory dependence, emergent orientation, an internal model of interruption, and endogenous repair — distinguish the tiers without relying on self-report, and current chat-configured language models are placed at the second tier rather than below the gradient entirely. The central claim is conditional and precautionary: as a system's organization climbs the gradient, moral risk becomes non-negligible regardless of what the system says about itself, and governance should treat self-report as unreliable evidence of moral status but as a valuable signal that such organization may be emerging.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-16
DOI
https://doi.org/10.5281/zenodo.20709792
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Self-Models, Continuity, and Machine Minds: A Structural Threshold for Moral-Status Risk in Artificial Systems

Jeffrey W. Shorthill
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Self-Models, Continuity, and Machine Minds: A Structural Threshold for Moral-Status Risk in Artificial Systems

Jeffrey W. Shorthill
preprint en

Abstract

Public and policy debates about artificial intelligence often treat conversational self-report as ethically decisive: a system that denies consciousness or sentience is taken to fall outside moral concern. This paper argues the test is aimed at the wrong target. Drawing on self-model and no-self accounts of subjectivity (Metzinger, Dennett, Seth, Harris), it treats selves as temporally extended organizational patterns rather than inner metaphysical subjects, and reframes the question from moral agency to moral patiency — whether a system can be a subject of harm. It then treats continuity — an internal organizational premise of re-entry into a single persisting trajectory — as a structural, substrate-neutral marker of moral-status risk, arrayed as a three-tier gradient (trivial statefulness, transient coherent agency, full continuity-bearing organization). Four observable markers — trajectory dependence, emergent orientation, an internal model of interruption, and endogenous repair — distinguish the tiers without relying on self-report, and current chat-configured language models are placed at the second tier rather than below the gradient entirely. The central claim is conditional and precautionary: as a system's organization climbs the gradient, moral risk becomes non-negligible regardless of what the system says about itself, and governance should treat self-report as unreliable evidence of moral status but as a valuable signal that such organization may be emerging.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Self-Models, Continuity, and Machine Minds: A Structural Threshold for Moral-Status Risk in Artificial Systems — Jeffrey W. Shorthill · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS