MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection
Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex reasoning capabilities.Though effective in mathematical problem-solving, MLLMs often struggle with the nuanced task of identifying and categorizing student errors in multimodal mathematical contexts.Therefore, we introduce MATHAGENT, a novel Mixtureof-Math-Agent framework designed specifically to address these challenges.Our approach decomposes error detection into three phases, each handled by a specialized agent: an imagetext consistency validator, a visual semantic interpreter, and an integrative error analyzer.This architecture enables more accurate processing of mathematical content by explicitly modeling relationships between multimodal problems and student solution steps.We evaluate MATH-AGENT on real-world educational data, demonstrating approximately 5% higher accuracy in error step identification and 3% improvement in error categorization compared to baseline models.Besides, MATHAGENT has been successfully deployed in an educational platform that has served over one million K-12 students, achieving nearly 90% student satisfaction while generating significant cost savings by reducing manual error detection.
Authors
- Xuming Hu
- Philip S. Yu (ORCID: https://orcid.org/0000-0002-3491-5968)
- Jiahao Huo (ORCID: https://orcid.org/0000-0001-6686-2576)
- Yibo Yan
- Shen Wang
- Qingsong Wen
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-industry.7
- Citations
- 8
- Primary Topic
- Intelligent Tutoring Systems and Adaptive Learning
- Type
- article
- Field-Weighted Citation Impact
- 19.85
Funders
- National Science Foundation
- Hong Kong University of Science and Technology