THE CONSCIOUSNESS SIMULATION GAP: EVALUATING AND BENCHMARKING AI MODELS THROUGH FUNCTIONAL DECOMPOSITION

The relevance of the research is determined by the need to study the consciousness of neural networks and the possibility of developing artificial self-awareness. The aim of the article is to investigate the main functional elements of models of consciousness in artificial intelligence (AI). The study employed such methods as the Turing test, Context-driven Testing and analysis of generation models. F1-score, Accuracy, t-test were used for statistical analysis. The reliability of the selected methods was checked by Test-Retest Reliability. The results were obtained that demonstrate the key aspects of the functioning of artificial consciousness models. GPT-4 shows the highest accuracy (92%) and F1-score (0.91), but has difficulties with complex logic problems. AlphaZero has the lowest accuracy (85%) and has trouble understanding abstract concepts. IBM Watson shows medium performance, but does not recognize irony well. DeepMind’s Gato is 90% accurate and wrong on coreference problems. The resulting analysis showed that modern models, such as GPT-4, have a high level of development of perception and attention, which contributes to the effective processing of natural language. However, the question of true consciousness and self-awareness of AI remains open, requiring further research. Understanding the functional components of consciousness is important for the development of ethical norms in the field of AI. Therefore, it is necessary to improve the algorithms to grade up the cognitive functions of the models. Prospects for future research in neural network consciousness include an in-depth study of the mechanisms that provide true consciousness and self-awareness in artificial systems.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-05-31
DOI
https://doi.org/10.5281/zenodo.17253825
Primary Topic
Genomics and Phylogenetic Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

THE CONSCIOUSNESS SIMULATION GAP: EVALUATING AND BENCHMARKING AI MODELS THROUGH FUNCTIONAL DECOMPOSITION

Zenodo (CERN European Organization for Nuclear Research)
Genomics and Phylogenetic Studies
article

THE CONSCIOUSNESS SIMULATION GAP: EVALUATING AND BENCHMARKING AI MODELS THROUGH FUNCTIONAL DECOMPOSITION

article en

Abstract

The relevance of the research is determined by the need to study the consciousness of neural networks and the possibility of developing artificial self-awareness. The aim of the article is to investigate the main functional elements of models of consciousness in artificial intelligence (AI). The study employed such methods as the Turing test, Context-driven Testing and analysis of generation models. F1-score, Accuracy, t-test were used for statistical analysis. The reliability of the selected methods was checked by Test-Retest Reliability. The results were obtained that demonstrate the key aspects of the functioning of artificial consciousness models. GPT-4 shows the highest accuracy (92%) and F1-score (0.91), but has difficulties with complex logic problems. AlphaZero has the lowest accuracy (85%) and has trouble understanding abstract concepts. IBM Watson shows medium performance, but does not recognize irony well. DeepMind’s Gato is 90% accurate and wrong on coreference problems. The resulting analysis showed that modern models, such as GPT-4, have a high level of development of perception and attention, which contributes to the effective processing of natural language. However, the question of true consciousness and self-awareness of AI remains open, requiring further research. Understanding the functional components of consciousness is important for the development of ethical norms in the field of AI. Therefore, it is necessary to improve the algorithms to grade up the cognitive functions of the models. Prospects for future research in neural network consciousness include an in-depth study of the mechanisms that provide true consciousness and self-awareness in artificial systems.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 47%
Genomics and Phylogenetic Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.