Concept-Level Cognitive Modeling via Multimodal Interaction: A Neuro-Symbolic Hybrid Approach for Early Concept Acquisition

Concept-level cognitive modeling is fundamental to building intelligent systems that can interpret, reason, and interact with the world in a human-like manner. While recent advances in deep learning and multimodal representation have enabled impressive progress in pattern recognition, they fall short of capturing abstract, structured concepts such as spatial relations, agency, and containment that underpin human cognition. This paper presents a neuro-symbolic hybrid framework for early concept acquisition through multimodal interaction. Our approach integrates perceptual input from vision and language with symbolic abstraction, enabling the system to form and refine concept representations via active cross-modal grounding. Central to our method is a dynamic concept representation layer that links symbolic units to neural embeddings, allowing the model to incrementally build a structured concept space without requiring predefined ontologies or exhaustive retraining. An interactive learning loop drives the alignment between modalities, supports hypothesis testing, and facilitates continual concept refinement. We validate our framework on both synthetic and real-world datasets across a range of conceptual tasks including spatial relation understanding, object function reasoning, and affordance inference. Experimental results demonstrate that our model outperforms purely neural and purely symbolic baselines in generalization, interpretability, and adaptability. This work contributes to the development of cognitively inspired AI systems that learn abstract knowledge from interaction, bridging the gap between subsymbolic perception and symbolic reasoning.

Authors

Institutions

Publication Details

Journal
International Journal of Pattern Recognition and Artificial Intelligence
Published
2025-11-05
DOI
https://doi.org/10.1142/s0218001425500302
Primary Topic
Child and Animal Learning Development
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Concept-Level Cognitive Modeling via Multimodal Interaction: A Neuro-Symbolic Hybrid Approach for Early Concept Acquisition

Yongfang Ma, Tao Wang, Rong Zhang
International Journal of Pattern Recognition and Artificial Intelligence
Child and Animal Learning Development
article

Concept-Level Cognitive Modeling via Multimodal Interaction: A Neuro-Symbolic Hybrid Approach for Early Concept Acquisition

Yongfang Ma, Tao Wang, Rong Zhang
article en

Abstract

Concept-level cognitive modeling is fundamental to building intelligent systems that can interpret, reason, and interact with the world in a human-like manner. While recent advances in deep learning and multimodal representation have enabled impressive progress in pattern recognition, they fall short of capturing abstract, structured concepts such as spatial relations, agency, and containment that underpin human cognition. This paper presents a neuro-symbolic hybrid framework for early concept acquisition through multimodal interaction. Our approach integrates perceptual input from vision and language with symbolic abstraction, enabling the system to form and refine concept representations via active cross-modal grounding. Central to our method is a dynamic concept representation layer that links symbolic units to neural embeddings, allowing the model to incrementally build a structured concept space without requiring predefined ontologies or exhaustive retraining. An interactive learning loop drives the alignment between modalities, supports hypothesis testing, and facilitates continual concept refinement. We validate our framework on both synthetic and real-world datasets across a range of conceptual tasks including spatial relation understanding, object function reasoning, and affordance inference. Experimental results demonstrate that our model outperforms purely neural and purely symbolic baselines in generalization, interpretability, and adaptability. This work contributes to the development of cognitively inspired AI systems that learn abstract knowledge from interaction, bridging the gap between subsymbolic perception and symbolic reasoning.

International Journal of Pattern Recognition and Artificial IntelligenceVol. 39(16)
Ningxia University (CN)
Openalex Percentile: Top 65%
Child and Animal Learning Development
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Concept-Level Cognitive Modeling via Multimodal Interaction: A Neuro-Symbolic Hybrid Approach for Early Concept Acquisition — Yongfang Ma, Tao Wang, et al. · International Journal of Pattern Recognition and Artificial Intelligence (2025) | TGRS Research Map | TGRS