Tanvir Fatima Naik Bukht¹, Naif Al Mudawi², Saud S. Alotaibi³, Abdulwahab Alazeb², Mohammed Alonazi⁴, Aisha Ahmed AlArfaj⁵, Ahmad Jalal¹, Jaekwang Kim^6,*

CMC-Computers, Materials & Continua, Vol.77, No.2, pp. 1557-1573, 2023, DOI:10.32604/cmc.2023.041335 - 29 November 2023

Abstract Human-human interaction recognition is crucial in computer vision fields like surveillance, human-computer interaction, and social robotics. It enhances systems’ ability to interpret and respond to human behavior precisely. This research focuses on recognizing human interaction behaviors using a static image, which is challenging due to the complexity of diverse actions. The overall purpose of this study is to develop a robust and accurate system for human interaction recognition. This research presents a novel image-based human interaction recognition method using a Hidden Markov Model (HMM). The technique employs hue, saturation, and intensity (HSI) color transformation to… More >

Rosepreet Kaur Bhogal^1,*, V. Devendran²

Computer Systems Science and Engineering, Vol.47, No.3, pp. 2759-2772, 2023, DOI:10.32604/csse.2023.034862 - 09 November 2023

Abstract Human activity recognition is a recent area of research for researchers. Activity recognition has many applications in smart homes to observe and track toddlers or oldsters for their safety, monitor indoor and outdoor activities, develop Tele immersion systems, or detect abnormal activity recognition. Three dimensions (3D) skeleton data is robust and somehow view-invariant. Due to this, it is one of the popular choices for human action recognition. This paper proposed using a transversal tree from 3D skeleton data to represent videos in a sequence. Further proposed two neural networks: convolutional neural network recurrent neural network_1… More >

Yong Li^1,4, Qiming Liang^2,*, Bo Gan³, Xiaolong Cui⁴

CMC-Computers, Materials & Continua, Vol.77, No.1, pp. 1-23, 2023, DOI:10.32604/cmc.2023.042494 - 31 October 2023

Abstract Action recognition and detection is an important research topic in computer vision, which can be divided into action recognition and action detection. At present, the distinction between action recognition and action detection is not clear, and the relevant reviews are not comprehensive. Thus, this paper summarized the action recognition and detection methods and datasets based on deep learning to accurately present the research status in this field. Firstly, according to the way that temporal and spatial features are extracted from the model, the commonly used models of action recognition are divided into the two stream… More >

Muhammad Naeem Akbar^1,*, Seemab Khan², Muhammad Umar Farooq¹, Majed Alhaisoni³, Usman Tariq⁴, Muhammad Usman Akram¹

CMC-Computers, Materials & Continua, Vol.76, No.3, pp. 3275-3295, 2023, DOI:10.32604/cmc.2023.039289 - 08 October 2023

Abstract The combination of spatiotemporal videos and essential features can improve the performance of human action recognition (HAR); however, the individual type of features usually degrades the performance due to similar actions and complex backgrounds. The deep convolutional neural network has improved performance in recent years for several computer vision applications due to its spatial information. This article proposes a new framework called for video surveillance human action recognition dubbed HybridHR-Net. On a few selected datasets, deep transfer learning is used to pre-trained the EfficientNet-b0 deep learning model. Bayesian optimization is employed for the tuning of… More >

Inzamam Mashood Nasir^1,*, Mudassar Raza¹, Jamal Hussain Shah¹, Muhammad Attique Khan², Yun-Cheol Nam³, Yunyoung Nam^4,*

CMC-Computers, Materials & Continua, Vol.76, No.3, pp. 2667-2684, 2023, DOI:10.32604/cmc.2023.035214 - 08 October 2023

Abstract Human Action Recognition (HAR) in uncontrolled environments targets to recognition of different actions from a video. An effective HAR model can be employed for an application like human-computer interaction, health care, person tracking, and video surveillance. Machine Learning (ML) approaches, specifically, Convolutional Neural Network (CNN) models had been widely used and achieved impressive results through feature fusion. The accuracy and effectiveness of these models continue to be the biggest challenge in this field. In this article, a novel feature optimization algorithm, called improved Shark Smell Optimization (iSSO) is proposed to reduce the redundancy of extracted… More >

Motasem S. Alsawadi^1,*, El-Sayed M. El-kenawy², Miguel Rio¹

Intelligent Automation & Soft Computing, Vol.37, No.3, pp. 2767-2782, 2023, DOI:10.32604/iasc.2023.039440 - 11 September 2023

Abstract The BlazePose, which models human body skeletons as spatiotemporal graphs, has achieved fantastic performance in skeleton-based action identification. Skeleton extraction from photos for mobile devices has been made possible by the BlazePose system. A Spatial-Temporal Graph Convolutional Network (STGCN) can then forecast the actions. The Spatial-Temporal Graph Convolutional Network (STGCN) can be improved by simply replacing the skeleton input data with a different set of joints that provide more information about the activity of interest. On the other hand, existing approaches require the user to manually set the graph’s topology and then fix it across… More >

Gyu-Il Kim¹, Hyun Yoo², Kyungyong Chung^3,*

Computer Systems Science and Engineering, Vol.47, No.2, pp. 2135-2152, 2023, DOI:10.32604/csse.2023.041030 - 28 July 2023

Abstract Artificial intelligence is increasingly being applied in the field of video analysis, particularly in the area of public safety where video surveillance equipment such as closed-circuit television (CCTV) is used and automated analysis of video information is required. However, various issues such as data size limitations and low processing speeds make real-time extraction of video data challenging. Video analysis technology applies object classification, detection, and relationship analysis to continuous 2D frame data, and the various meanings within the video are thus analyzed based on the extracted basic data. Motion recognition is key in this analysis.… More >

Mengmeng Yan¹, Chuang Zhang^1,2,*, Jinqi Chu¹, Haichao Zhang¹, Tao Ge¹, Suting Chen¹

Computer Systems Science and Engineering, Vol.47, No.2, pp. 1433-1449, 2023, DOI:10.32604/csse.2023.040132 - 28 July 2023

Abstract An action recognition network that combines multi-level spatiotemporal feature fusion with an attention mechanism is proposed as a solution to the issues of single spatiotemporal feature scale extraction, information redundancy, and insufficient extraction of frequency domain information in channels in 3D convolutional neural networks. Firstly, based on 3D CNN, this paper designs a new multilevel spatiotemporal feature fusion (MSF) structure, which is embedded in the network model, mainly through multilevel spatiotemporal feature separation, splicing and fusion, to achieve the fusion of spatial perceptual fields and short-medium-long time series information at different scales with reduced network… More >

Xuan Zhou^1,*, Jianping Yi²

Intelligent Automation & Soft Computing, Vol.37, No.2, pp. 2103-2116, 2023, DOI:10.32604/iasc.2023.034855 - 21 June 2023

Abstract Mining more discriminative temporal features to enrich temporal context representation is considered the key to fine-grained action recognition. Previous action recognition methods utilize a fixed spatiotemporal window to learn local video representation. However, these methods failed to capture complex motion patterns due to their limited receptive field. To solve the above problems, this paper proposes a lightweight Temporal Pyramid Excitation (TPE) module to capture the short, medium, and long-term temporal context. In this method, Temporal Pyramid (TP) module can effectively expand the temporal receptive field of the network by using the multi-temporal kernel decomposition without More >

Praveen Jesudhas^1,*, T. Raghuveera²

Computer Systems Science and Engineering, Vol.46, No.3, pp. 2995-3015, 2023, DOI:10.32604/csse.2023.036778 - 03 April 2023

Abstract Timely identification and treatment of medical conditions could facilitate faster recovery and better health. Existing systems address this issue using custom-built sensors, which are invasive and difficult to generalize. A low-complexity scalable process is proposed to detect and identify medical conditions from 2D skeletal movements on video feed data. Minimal set of features relevant to distinguish medical conditions: AMF, PVF and GDF are derived from skeletal data on sampled frames across the entire action. The AMF (angular motion features) are derived to capture the angular motion of limbs during a specific action. The relative position… More >