MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection

Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex reasoning capabilities.Though effective in mathematical problem-solving, MLLMs often struggle with the nuanced task of identifying and categorizing student errors in multimodal mathematical contexts.Therefore, we introduce MATHAGENT, a novel Mixtureof-Math-Agent framework designed specifically to address these challenges.Our approach decomposes error detection into three phases, each handled by a specialized agent: an imagetext consistency validator, a visual semantic interpreter, and an integrative error analyzer.This architecture enables more accurate processing of mathematical content by explicitly modeling relationships between multimodal problems and student solution steps.We evaluate MATH-AGENT on real-world educational data, demonstrating approximately 5% higher accuracy in error step identification and 3% improvement in error categorization compared to baseline models.Besides, MATHAGENT has been successfully deployed in an educational platform that has served over one million K-12 students, achieving nearly 90% student satisfaction while generating significant cost savings by reducing manual error detection.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-industry.7
Citations
8
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
19.85

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection

Xuming Hu, Philip S. Yu, Jiahao Huo, Yibo Yan et al.
8 citations
Intelligent Tutoring Systems and Adaptive Learning
19.85
article

MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection

Xuming Hu, Philip S. Yu, Jiahao Huo, Yibo Yan, Shen Wang, Qingsong Wen
article en
8 citations

Abstract

Mathematical error detection in educational settings presents a significant challenge for Multimodal Large Language Models (MLLMs), requiring a sophisticated understanding of both visual and textual mathematical content along with complex reasoning capabilities.Though effective in mathematical problem-solving, MLLMs often struggle with the nuanced task of identifying and categorizing student errors in multimodal mathematical contexts.Therefore, we introduce MATHAGENT, a novel Mixtureof-Math-Agent framework designed specifically to address these challenges.Our approach decomposes error detection into three phases, each handled by a specialized agent: an imagetext consistency validator, a visual semantic interpreter, and an integrative error analyzer.This architecture enables more accurate processing of mathematical content by explicitly modeling relationships between multimodal problems and student solution steps.We evaluate MATH-AGENT on real-world educational data, demonstrating approximately 5% higher accuracy in error step identification and 3% improvement in error categorization compared to baseline models.Besides, MATHAGENT has been successfully deployed in an educational platform that has served over one million K-12 students, achieving nearly 90% student satisfaction while generating significant cost savings by reducing manual error detection.

National Science Foundation, Hong Kong University of Science and Technology
Openalex Percentile: Top 1%
Intelligent Tutoring Systems and Adaptive Learning
19.85
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection — Xuming Hu, Philip S. Yu, et al. · (2025) | TGRS Research Map | TGRS