Pose and attention mechanism based behavior recognition method and its application in education

Xia Zhu; Mingxing Li

doi:10.1117/12.3009282

11 October 2023 Pose and attention mechanism based behavior recognition method and its application in education

Xia Zhu, Mingxing Li

Proceedings Volume 12918, Fourth International Conference on Computer Science and Communication Technology (ICCSCT 2023); 1291829 (2023) https://doi.org/10.1117/12.3009282
Event: International Conference on Computer Science and Communication Technology (ICCSCT 2023), 2023, Wuhan, China

Abstract

Behavior recognition is an important research domain in computer vision. Extracting human motion features and identifying behaviors from video can provide important support for education, medical treatment, security, and other fields. However, current mainstream behavior recognition methods prove ineffective in the challenging context of recognizing students’ classroom behavior due to scene complexity, numerous interfering factors, and lack of public datasets. To address these limitations, this paper presents a novel recognition model that integrates behavioral pose information and attention mechanisms. The proposed model employs a residual convolutional neural network with an attention mechanism to extract spatial and temporal features from teaching videos while leveraging behavioral pose information to enhance the description of visual cues and capture high-level behavioral information embedded in depth features. To assess the model's effectiveness, we create a comprehensive dataset of students' classroom behavior and conduct extensive experiments. The results demonstrate the proposed model's high performance in recognizing college students' classroom behavior.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xia Zhu and Mingxing Li "Pose and attention mechanism based behavior recognition method and its application in education", Proc. SPIE 12918, Fourth International Conference on Computer Science and Communication Technology (ICCSCT 2023), 1291829 (11 October 2023); https://doi.org/10.1117/12.3009282

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available