Evaluating artificial general intelligence across architectures and task families

Artificial general intelligence describes the ability to learn, reason, and adapt across a broad range of cognitive tasks. Evidence for that ability depends on what transfers, to which tasks, and under what conditions. This critical narrative review compares symbolic architectures, connectionist learning, reinforcement learning, neuroscience-inspired and embodied systems, universal formal agents, and neurosymbolic hybrids. It relates each research program’s assumptions to the capabilities its evaluations can establish. Formal results on optimization and sample complexity clarify the role of task distributions and hypothesis restrictions. A finite-class calculation illustrates how a sufficient sample bound changes with description length and error tolerance. A second calculation shows how arithmetic and geometric means can reverse the ranking of two hypothetical capability profiles and how changing the task-family weights can reverse it again. These results motivate an evaluation protocol that reports family-level outcomes, human comparators, resource conditions, and uncertainty alongside the aggregate. Published studies demonstrate transfer within defined settings and strong performance in some specialized tasks. Whether comparable performance can be sustained across unfamiliar tasks and changing environments remains open. The protocol and reference architecture identify evidence that would help answer that question.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-16
DOI
https://doi.org/10.5281/zenodo.24268926
Primary Topic
Psychiatry, Mental Health, Neuroscience
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Evaluating artificial general intelligence across architectures and task families

Chris Gilbert
2 links
Zenodo (CERN European Organization for Nuclear Research)
Psychiatry, Mental Health, Neuroscience
preprint

Evaluating artificial general intelligence across architectures and task families

Chris Gilbert
preprint en

Abstract

Artificial general intelligence describes the ability to learn, reason, and adapt across a broad range of cognitive tasks. Evidence for that ability depends on what transfers, to which tasks, and under what conditions. This critical narrative review compares symbolic architectures, connectionist learning, reinforcement learning, neuroscience-inspired and embodied systems, universal formal agents, and neurosymbolic hybrids. It relates each research program’s assumptions to the capabilities its evaluations can establish. Formal results on optimization and sample complexity clarify the role of task distributions and hypothesis restrictions. A finite-class calculation illustrates how a sufficient sample bound changes with description length and error tolerance. A second calculation shows how arithmetic and geometric means can reverse the ranking of two hypothetical capability profiles and how changing the task-family weights can reverse it again. These results motivate an evaluation protocol that reports family-level outcomes, human comparators, resource conditions, and uncertainty alongside the aggregate. Published studies demonstrate transfer within defined settings and strong performance in some specialized tasks. Whether comparable performance can be sustained across unfamiliar tasks and changing environments remains open. The protocol and reference architecture identify evidence that would help answer that question.

Zenodo (CERN European Organization for Nuclear Research)
William V. S. Tubman University (LR)
Psychiatry, Mental Health, Neuroscience
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon