Efficient Classroom Behavior Detection through End-to End Multiscale Feature Fusion

Classroom behavior detection is essential for smart education. Enhance teaching effectiveness, promote personalized learning, and support holistic student development. Existing methods that rely on single-feature input are susceptible to noise interference, which can lead to misjudgments in classroom behavior detection. This paper proposes an efficient classroom behavior detection through end-to-end multiscale feature fusion. Initially, the original YOLOv7 input module was replaced with a multi-feature information input module to enhance spatial feature utilization efficiency. Then, a feature weight attention mechanism was incorporated to allow the main network to weigh feature information on various scales comprehensively. This approach has improved the accuracy of the algorithm’s identification and reduced the number of network parameters. Finally, including a focal loss function suppressed background interference, improving recognition accuracy. Experimental results demonstrate that the improved algorithm attains 94.1% accuracy in the RizeHand dataset and effectively recognizes student behaviors in real-world scenarios.

Authors

Institutions

Publication Details

Published
2024-12-01
DOI
https://doi.org/10.1145/3703619.3706046
Citations
2
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Classroom Behavior Detection through End-to End Multiscale Feature Fusion

Xianxuan Lin, Tariq Hussain, Wei Sun, Chuangxin Cai et al.
2 citations
Human Pose and Action Recognition
0.50
article

Efficient Classroom Behavior Detection through End-to End Multiscale Feature Fusion

Xianxuan Lin, Tariq Hussain, Wei Sun, Chuangxin Cai, Zhigeng Pan, Jing Zhang
article en
2 citations

Abstract

Classroom behavior detection is essential for smart education. Enhance teaching effectiveness, promote personalized learning, and support holistic student development. Existing methods that rely on single-feature input are susceptible to noise interference, which can lead to misjudgments in classroom behavior detection. This paper proposes an efficient classroom behavior detection through end-to-end multiscale feature fusion. Initially, the original YOLOv7 input module was replaced with a multi-feature information input module to enhance spatial feature utilization efficiency. Then, a feature weight attention mechanism was incorporated to allow the main network to weigh feature information on various scales comprehensively. This approach has improved the accuracy of the algorithm’s identification and reduced the number of network parameters. Finally, including a focal loss function suppressed background interference, improving recognition accuracy. Experimental results demonstrate that the improved algorithm attains 94.1% accuracy in the RizeHand dataset and effectively recognizes student behaviors in real-world scenarios.

Shenyang Ligong University (CN), Nanjing University of Information Science and Technology (CN), Zhejiang Gongshang University (CN)
Openalex Percentile: Top 32%
Human Pose and Action Recognition
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficient Classroom Behavior Detection through End-to End Multiscale Feature Fusion — Xianxuan Lin, Tariq Hussain, et al. · (2024) | TGRS Research Map | TGRS