Exploring the Application of Visual Question Answering (VQA) for Classroom Activity Monitoring

Classroom behavior monitoring is a critical aspect of educational research, with significant implications for student engagement and learning outcomes. Recent advancements in Visual Question Answering (VQA) models offer promising tools for automatically analyzing complex classroom interactions from video recordings. In this paper, we investigate the applicability of several state-of-the-art open-source VQA models, including VideoLLaMA2, VideoLLaMA3, QWEN3, and NVILA, in the context of classroom behavior analysis.To facilitate rigorous evaluation, we introduce our BAV-Classroom-VQA dataset derived from real-world classroom video recordings at the Banking Academy of Vietnam. We present the methodology for data collection, annotation, and benchmark the performance of the selected VQA models on this dataset. Our initial experimental results demonstrate that all four models achieve promising performance levels in answering behavior-related visual questions, showcasing their potential in future classroom analytics and intervention systems.

Authors

Institutions

Publication Details

Published
2025-10-21
DOI
https://doi.org/10.1145/3746274.3760394
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring the Application of Visual Question Answering (VQA) for Classroom Activity Monitoring

Trong-Sinh Vu, Hieu Hoang, Thanh-Thuy Pham, Ngoc-Thanh Le et al.
Multimodal Machine Learning Applications
article

Exploring the Application of Visual Question Answering (VQA) for Classroom Activity Monitoring

Trong-Sinh Vu, Hieu Hoang, Thanh-Thuy Pham, Ngoc-Thanh Le, Tai Tan, Duy Manh Nguyen, Hieu Trung Pham
article en

Abstract

Classroom behavior monitoring is a critical aspect of educational research, with significant implications for student engagement and learning outcomes. Recent advancements in Visual Question Answering (VQA) models offer promising tools for automatically analyzing complex classroom interactions from video recordings. In this paper, we investigate the applicability of several state-of-the-art open-source VQA models, including VideoLLaMA2, VideoLLaMA3, QWEN3, and NVILA, in the context of classroom behavior analysis.To facilitate rigorous evaluation, we introduce our BAV-Classroom-VQA dataset derived from real-world classroom video recordings at the Banking Academy of Vietnam. We present the methodology for data collection, annotation, and benchmark the performance of the selected VQA models on this dataset. Our initial experimental results demonstrate that all four models achieve promising performance levels in answering behavior-related visual questions, showcasing their potential in future classroom analytics and intervention systems.

The State Bank of Vietnam (VN), Dublin City University (IE), Banking Academy of Vietnam
Openalex Percentile: Top 70%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.