Thousand Brains Systems: Sensorimotor Intelligence for Rapid, Robust Learning and Inference

Current AI systems achieve impressive performance on many tasks, yet they lack core attributes of biological intelligence, including rapid, continual learning, representations grounded in sensorimotor interactions, and structured knowledge that enables efficient generalization. Neuroscience theory suggests that mammals evolved flexible intelligence through the replication of a semi-independent, sensorimotor module, a functional unit known as a cortical column. To address the disparity between biological and artificial intelligence, Thousand Brains systems were proposed as a means of mirroring the architecture of cortical columns and their interactions. In our current work, we evaluate the unique properties of Monty, the first implementation of a Thousand Brains system. We focus on 3D object perception and, in particular, the combined task of object recognition and pose estimation. Utilizing the YCB data set of household objects, we first assess Monty's use of sensorimotor learning to build structured representations, finding that these enable robust generalization. These representations include an emphasis on classifying objects by their global shape, as well as a natural ability to detect object symmetries. We then explore Monty's use of model-free and model-based policies to enable rapid inference by supporting principled movements. We find that such policies complement Monty's modular architecture, a design that can accommodate communication between modules to further accelerate inference speed via a novel voting algorithm. Finally, we examine Monty's use of associative, Hebbian-like binding to enable rapid, continual, and computationally efficient learning, properties that compare favorably to current deep learning architectures. While Monty is still in a nascent stage of development, these findings support Thousand Brains systems as a powerful and promising new approach to AI and reinforce the importance of sensorimotor learning for developing intelligent systems.