A Reinforcement-Optimized Multimodal Symbolic Reasoning Approach for Mathematical Problem Solving
We propose RPR-LLaVA, a reinforcementaugmented program reasoning framework targeting multimodal mathematical tasks that integrate visual perception with symbolic reasoning. The model integrates triple encoding of images, text, and symbolic programs to capture rich semantics across modalities. A symbolic reasoning engine executes domainspecific programs step-by-step, while a reinforcement learning optimizer refines reasoning quality using multi-objective rewards. Training follows a two-stage pipeline, combining supervised learning with policy-gradient fine-tuning. RPR-LLaVA enhances interpretability and symbolic precision, offering a new direction for unifying visual-language models with structured reasoning in educational contexts.
Authors
- Junchen Liu (ORCID: https://orcid.org/0009-0003-4692-7776)
- Xinrui Li (ORCID: https://orcid.org/0000-0001-8466-1778)
Institutions
- Boston University (US)
- The University of Texas at Austin (US)
Publication Details
- Published
- 2025-06-27
- DOI
- https://doi.org/10.1109/icaita67588.2025.11137924
- Citations
- 5
- Primary Topic
- Intelligent Tutoring Systems and Adaptive Learning
- Type
- article
- Field-Weighted Citation Impact
- 12.40