Vol.30, No.2, 2021, pp.673-688, doi:10.32604/iasc.2021.020240
An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection
  • Jiahui Pan1,2,*, Liangxin Liu1, Mianfen Lin1, Shengzhou Luo1, Chengju Zhou1, Huijian Liao3, Fei Wang1,2
1 School of Software, South China Normal University, Foshan, 528225, China
2 Pazhou Lab, Guangzhou, 510330, China
3 Department of Mechanical, Materials and Manufacturing Engineering, University of Nottingham, Nottingham, NG7 2RD, United Kingdom
* Corresponding Author: Jiahui Pan. Email:
Received 16 May 2021; Accepted 18 June 2021; Issue published 11 August 2021
Abnormal behavior detection is an essential step in a wide range of application domains, such as smart video surveillance. In this study, we proposed an improved two-stream inflated 3D ConvNet network approach based on probability regression for abnormal behavior detection. The proposed approach consists of four parts: (1) preprocessing pretreatment for the input video; (2) dynamic feature extraction from video streams using a two-stream inflated 3D (I3D) ConvNet network; (3) visual feature transfer into a two-dimensional matrix; and (4) feature classification using a generalized regression neural network (GRNN), which ultimately achieves a probability regression. Compared with the traditional methods, two-stream I3D feature extraction technology is better able to extract visual features and retain the optical flow and red, green and blue (RGB) information in the video. Probabilistic regression technology is better able to quantify data and provide a more intuitive visual experience. The experimental results on 50 detection cases from the UCF-Crime dataset show that the developed model obtains a high average abnormal behavior recognition accuracy. The improved I3D models obtain an average accuracy of 93.7% based on UCF-101, which outperforms the state-of-the-art methods, verifying the robustness and effectiveness of our approach.
Abnormal behavior detection; two-stream inflated 3D convnet network; general regression neural network; python
Cite This Article
Pan, J., Liu, L., Lin, M., Luo, S., Zhou, C. et al. (2021). An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection. Intelligent Automation & Soft Computing, 30(2), 673–688.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.