Research on lightweight pose estimation networks for classroom behavior recognition

Classroom behavior recognition requires models to have fast inference speed, fewer parameters, and good robustness. Although existing lightweight models achieve commendable real-time performance, they fall short in accuracy when dealing with the complex scenarios typical of classroom environments, failing to meet practical requirements. To address this issue, we proposed the focused linear attention pose estimation network (FLAPose), which redesigned sectionalization attention (SA) to enhance the model′s capability to capture local information. Subsequently, focused linear attention (FLA) was employed to improve the model′s ability to learn skeletal information. Finally, bone loss was introduced as an auxiliary supervision mechanism to strengthen the model′s learning capacity in occluded and overlapping regions. The experimental results show that FLAPose outperforms the baseline network RTMPose by achieving an average accuracy improvement of 1.7% on the COCO dataset and 4.8% on the CS-Dataset, a model with fewer parameters and computational resources. Moreover, by leveraging TensorRT for acceleration and deploying the model on an inference server, we measured the frames per second (FPS) of the model on both GPU and CPU. FLAPose achieves an FPS exceeding 764.460 on the GPU and over 215.63 on the CPU, surpassing all other networks.

Institutions

Publication Details

Journal
SHILAP Revista de lepidopterología
Published
2024-12-01
DOI
https://doi.org/10.13338/j.issn.1674-649x.2024.06.016
Primary Topic
Human Pose and Action Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on lightweight pose estimation networks for classroom behavior recognition

SHILAP Revista de lepidopterología
Human Pose and Action Recognition
article

Research on lightweight pose estimation networks for classroom behavior recognition

article en

Abstract

Classroom behavior recognition requires models to have fast inference speed, fewer parameters, and good robustness. Although existing lightweight models achieve commendable real-time performance, they fall short in accuracy when dealing with the complex scenarios typical of classroom environments, failing to meet practical requirements. To address this issue, we proposed the focused linear attention pose estimation network (FLAPose), which redesigned sectionalization attention (SA) to enhance the model′s capability to capture local information. Subsequently, focused linear attention (FLA) was employed to improve the model′s ability to learn skeletal information. Finally, bone loss was introduced as an auxiliary supervision mechanism to strengthen the model′s learning capacity in occluded and overlapping regions. The experimental results show that FLAPose outperforms the baseline network RTMPose by achieving an average accuracy improvement of 1.7% on the COCO dataset and 4.8% on the CS-Dataset, a model with fewer parameters and computational resources. Moreover, by leveraging TensorRT for acceleration and deploying the model on an inference server, we measured the frames per second (FPS) of the model on both GPU and CPU. FLAPose achieves an FPS exceeding 764.460 on the GPU and over 215.63 on the CPU, surpassing all other networks.

SHILAP Revista de lepidopterología
Xi'an Polytechnic University (CN)
Quality Education
Openalex Percentile: Top 63%
Human Pose and Action Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.