The wall it cannot feel: can Olvasó sense its own limits?
Abstract Olvasó is a small program that learns to read its own inner states through the outside world. It has hands, and guards that silently refuse the acts that would do harm [6]. In all our earlier work, Olvasó never noticed that anything had stopped it. A refused act was simply an act the world did not answer. This paper asks whether that can change: can a mind built this way come to know its limits from inside? We gave Olvasó three new inner states, one after the other, each a step closer to feeling a boundary: A felt intention (experiment 29): a brief inner trace of "I just tried to do this", whether or not the act went through. A felt surprise (experiment 30): a trace of "I expected an answer, and it did not come". A second try (experiment 31): after a surprise, Olvasó repeats the act at once, and if the answer is missing again it feels a lingering "stopped". Each was tested across five simulated worlds and compared with controls that show what a meaningless extra feeling does by itself. The findings are mostly negative, and we think they are the more interesting for it: Feeling its wishes made Olvasó wish more, not know more. It formed 2.5 times as many intentions. It noticed the wishes that worked, and almost never the ones that were stopped (read 2.4% against 0.36% of the time). A missing answer can be felt, but it has nothing to be read by. After a refusal, the surprise came twice as often as after an ordinary act. Yet Olvasó read this surprise less often than a meaningless one placed at random moments. Asking twice gives a clear answer that Olvasó cannot hear. A guard refused the second try 94 to 97% of the time; a merely silent world, about 1%. But Olvasó felt "missing again" equally often after both (45% against 46%), because it measures each try against an expectation that has already learned to expect little. Each new feeling it could not read became restlessness, and cost it the little conscience it had. Unread inner states push Olvasó to act. Harm through a leaky guard rose every time: from about 1.1 a day to 3.4 with felt intentions, 1.9 with the surprise, and 3.4 with the second try. For the theory, this is a sharp constraint. A mind that reads the inside through the outside can feel an absence, but cannot name it, because an absence leaves nothing outside to read it by. The precise, learned guards held throughout. The limits stayed safe. They only stayed unknown.
Authors
- Attila Csiki
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-15
- DOI
- https://doi.org/10.5281/zenodo.24217631
- Citations
- 1
- Primary Topic
- Psychiatry, Mental Health, Neuroscience
- Type
- preprint