Mathematical Modeling of Binding Semantic Memory with Visual Information

This study investigates visual information processing and its integration with semantic memory with a hierarchical predictive coding with reservoir computing model. The model explores how visual elements like color and shape interact with semantic memory, focusing on the reverse Stroop effect. The model processes images of gendered toilet symbols, demonstrating that East Asian models, which use color cues for gender identification, exhibit quicker recognition than other models. The perception is accurate for images with consistent color and shape information but inaccurate for images with conflicting color and shape information. The results illustrate that the model effectively simulates the reverse Stroop effect, revealing insights into visual and semantic memory interactions.