Open Access

ARTICLE

A Novel Attention-Based Parallel Blocks Deep Architecture for Human Action Recognition

Yasir Khan Jadoon¹, Yasir Noman Khalid¹, Muhammad Attique Khan², Jungpil Shin^3,*, Fatimah Alhayan⁴, Hee-Chan Cho⁵, Byoungchol Chang^6,*

1 Department of Computer Engineering, HITECUniversity, Taxila, 47080, Pakistan
2 Deparment of AI, Prince Mohammad bin Fahd University, Al-Khobar, 31952, Saudi Arabia
3 Department of Computer Science and Engineering, University of Aizu, AizuWakamatsu, Fukushima, 965-0006, Japan
4 Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia
5 Center for Computational Social Science, Hanyang University, Seoul, 01000, Republic of Korea
6 Department of Computer Science, Hanyang University, Seoul, 01000, Republic of Korea

* Corresponding Authors: Jungpil Shin. Email: ; Byoungchol Chang. Email:

(This article belongs to the Special Issue: Machine Learning and Deep Learning-Based Pattern Recognition)

Computer Modeling in Engineering & Sciences 2025, 144(1), 1143-1164. https://doi.org/10.32604/cmes.2025.066984

Received 22 April 2025; Accepted 16 July 2025; Issue published 31 July 2025

Abstract

Real-time surveillance is attributed to recognizing the variety of actions performed by humans. Human Action Recognition (HAR) is a technique that recognizes human actions from a video stream. A range of variations in human actions makes it difficult to recognize with considerable accuracy. This paper presents a novel deep neural network architecture called Attention RB-Net for HAR using video frames. The input is provided to the model in the form of video frames. The proposed deep architecture is based on the unique structuring of residual blocks with several filter sizes. Features are extracted from each frame via several operations with specific parameters defined in the presented novel Attention-based Residual Bottleneck (Attention-RB) DCNN architecture. A fully connected layer receives an attention-based features matrix, and final classification is performed. Several hyperparameters of the proposed model are initialized using Bayesian Optimization (BO) and later utilized in the trained model for testing. In testing, features are extracted from the self-attention layer and passed to neural network classifiers for the final action classification. Two highly cited datasets, HMDB51 and UCF101, were used to validate the proposed architecture and obtained an average accuracy of 87.70% and 97.30%, respectively. The deep convolutional neural network (DCNN) architecture is compared with state-of-the-art (SOTA) methods, including pre-trained models, inside blocks, and recently published techniques, and performs better.

---

Keywords

---