Using CNN, GRU, and B/idirectional Multiscale Convolutional Neural Networks for Human Behavior Recognition
Main Article Content
Abstract
The main challenge in recognizing human behavior is constructing a network for the extraction and categorization of spatiotemporal features. In order to address the issue that the current channel attention mechanism simply aggregates each channel's global average information while ignoring its specific spatial information, this work suggests two enhanced channel attention modules: the depth separable convolutions section and the time-space (ST) interaction section of matrices operation. These modules are also combined with research on the recognition of human behavior. Proposing a multiple habitats convolutional neural network technique for human behavior detection, it is combined with the excellent performance using convolutional neural network (CNN) for video and image processing. First, the behavior video is divided into segments. Next, low rank learning is applied to each segment to extract the associated low rank actions information. Finally, these minimal position behavior information are linked together in the time axis to get the low are behavior data for the entire video. This allows for the efficient extraction of behavior information from the video without the need for laborious extraction processes or assumptions. Neural networks can simulate human behavior in a variety of network topologies by transferring and reusing this capacity. To lessen the distinction between features derived from various network topologies, two efficient feature difference measurement methods are presented, taking into account the various properties of data features at various network levels. The suggested strategy has a decent categorization impact, according to experiments on a number of available datasets. The experimental findings demonstrate that the method's accuracy in identifying human behavior is excellent. It has been shown that the suggested model increases recognition accuracy while simultaneously enhancing the compactness for the model structure and successfully lowering the computational cost of the output weights.
Downloads
Metrics
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
References
X.-J. Gu, P. Shen, H.-W. Liu, J. Guo, and Z.-F. Wei, "Human behavior recognition based on bone spatio-temporal map," Comput. Eng. Des., vol. 43, no. 4, pp. 1166-1172, 2022.
M. Z. Sun, P. Zhang, and B. Su, "Overview of human behavior recognition methods based on bone data features," Softw. Guide, vol. 21, no. 4, pp. 233-239, 2022.
Z. He, "Design and implementation of rehabilitation evaluation systems for the disabled based on behavior recognition," J. Changsha Civil Affairs Vocational Tech. College, vol. 29, no. 1, pp. 134-136, 2022.
C. Y. Zhang, H. Zhang, W. He, F. Zhao, W. Q. Li, T. Y. Xu, et al., "Video-based pedestrian detection and behavior recognition," China Sci. Technol. Inf., vol. 11, no. 6, pp. 132-135, 2022.
X. Ding, Y. Zhu, H. Zhu, and G. Liu, "Behavior recognition based on spatiotemporal heterogeneous two stream convolution network," Comput. Appl. Softw., vol. 39, no. 3, pp. 154-158, 2022.
S. Huang, "Progress and application prospect of video behavior recognition," High Tech Ind., vol. 27, no. 12, pp. 38-41, 2021.
Y. Lu, L. Fan, L. Guo, L. Qiu, and Y. Lu, "Identification method and experiment of unsafe behaviors of subway passengers based on Kinect," China Work Saf. Sci. Technol., vol. 17, no. 12, pp. 162-168, 2021.
X. Ma and J. Li, "Interactive behavior recognition based on low rank sparse optimization," J. Inner Mongolia Univ. Sci. Technol., vol. 40, no. 4, pp. 375-381, 2021.
Z. Zhai and Y. Zhao, "DS convLSTM: A lightweight video behavior recognition model for edge environments," J. Commun. Univ. China Natural Science Ed., vol. 28, no. 6, pp. 17-22, 2021.
C. Ying and S. Gong, "Human behavior recognition network based on improved channel attention mechanism," J. Electron. Inf., vol. 43, no. 12, pp. 3538-3545, 2021.
Z. Duan, Q. Ding, J. Wang, and W. Li, "Subway station lighting control method based on passenger behavior recognition," J. Railway Sci. Eng., vol. 18, no. 12, pp. 3138-3145, 2021.
D. Liu, J. Yang, and Q. Tang, "Research on identification technology of violations in key underground places based on video analysis," Proc. Excellent Papers Annu. Meeting Chongqing Mining Soc., pp. 71-75, 2021.
Y. Ye, "Key technology of human behavior recognition in intelligent device forensics based on deep learning," Apr. 2021.
Y. Li, "Mining the spatiotemporal distribution law of CNG gas dispensing substations and identifying abnormal behaviors based on machine learning," Apr. 2021.
W. Wang, "Research on behavior recognition based on video image and virtual reality interaction applications," Mar. 2021.
J. Wang, "Design and implementation of an enterprise e-mail security analysis platform based on user behavior identification," J. Shanghai Inst. Shipping Transp. Sci., vol. 43, no. 4, pp. 59-64, 2020.
K. Han and Z. Huang, "A fall behavior recognition method based on the dynamic characteristics of human posture," J. Hunan Univ. Natural Sci. Ed., vol. 47, no. 12, pp. 69-76, 2020.
F. Wang, "Research on attitude estimation and behavior recognition based on deep learning in logistics warehousing," 2020.
Y. Ying, "Analysis of prenatal behavior characteristics of Hu sheep and development of a monitoring system based on embedded systems," 2020.
J. Bao and H. Jin, "A semi-supervised learning method for identifying intrusion behaviors in ship LAN," Ship Sci. Technol., vol. 42, no. 24, pp. 136-138, 2020.
L. Zhang, Y. Zhang, M. Li, X. Shi, B. Zhai, and W. Wang, "Identification method of downhole personnel behavior based on CSI," J. Internet Things, vol. 4, no. 4, pp. 26-31, 2020.
Y. Zhang and K. Jia, "Case study on identification and prevention of financial fraud," Bus. Accounting, vol. 17, no. 24, pp. 101-104, 2020.
Y. Li and L. Xie, "A behavior recognition algorithm combining RGB-D video and convolutional neural network," Comput. Digit. Eng., vol. 48, no. 12, pp. 3052-3058, 2020.
H. Fang and Q. Lu, "Research on student classroom activity detection method based on behavior recognition," Inf. Syst. Eng., vol. 25, no. 12, pp. 27-29, 2020.
X. Cao, "Design and implementation of traffic violation recognition algorithm based on vehicle video," 2019.
Z. Xu, "Research on human behavior recognition technology based on depth feature fusion and its application in video surveillance," 2019.
Y. Yang, "Research on key algorithms and platform development and application of human motion behavior recognition in unrestricted scenes, Xinhua College," Mar. 2020.
X. Huang, "Human behavior recognition method based on point projection features of bone joints," Mod. Comput., vol. 12, no. 36, pp. 3-7, 2019.
J. Chen, X. Xie, J. Li, and G. Shi, "Behavior recognition method based on spatiotemporal attention mechanism," China Stereol. Image Anal., vol. 24, no. 4, pp. 325-333, 2019.
X. Han and T. Wu, "Human behavior recognition algorithm based on deep learning," Pract. Understand. Math., vol. 49, no. 24, pp. 133-139, 2019.