S. Gnanapriya^1,*, K. Rahimunnisa²

Intelligent Automation & Soft Computing, Vol.36, No.1, pp. 1105-1119, 2023, DOI:10.32604/iasc.2023.032832

Abstract The performance of Hand Gesture Recognition (HGR) depends on the hand shape. Segmentation helps in the recognition of hand gestures for more accuracy and improves the overall performance compared to other existing deep neural networks. The crucial segmentation task is extremely complicated because of the background complexity, variation in illumination etc. The proposed modified UNET and ensemble model of Convolutional Neural Networks (CNN) undergoes a two stage process and results in proper hand gesture recognition. The first stage is segmenting the regions of the hand and the second stage is gesture identification. The modified UNET segmentation model is trained using… More >

Zhengyuan Xu^1,2,#, Junxiao Yu^1,#, Wentao Xiang¹, Songsheng Zhu¹, Mubashir Hussain³, Bin Liu^1,*, Jianqing Li^1,*

CMES-Computer Modeling in Engineering & Sciences, Vol.134, No.1, pp. 157-177, 2023, DOI: 10.32604/cmes.2022.020035

Abstract In this article, to reduce the complexity and improve the generalization ability of current gesture recognition systems, we propose a novel SE-CNN attention architecture for sEMG-based hand gesture recognition. The proposed algorithm introduces a temporal squeeze-and-excite block into a simple CNN architecture and then utilizes it to recalibrate the weights of the feature outputs from the convolutional layer. By enhancing important features while suppressing useless ones, the model realizes gesture recognition efficiently. The last procedure of the proposed algorithm is utilizing a simple attention mechanism to enhance the learned representations of sEMG signals to perform multi-channel sEMG-based gesture recognition tasks.… More >

Muhammad Jamil Hussain¹, Ahmad Shaoor¹, Suliman A. Alsuhibany², Yazeed Yasin Ghadi³, Tamara al Shloul⁴, Ahmad Jalal¹, Jeongmin Park^5,*

CMC-Computers, Materials & Continua, Vol.72, No.3, pp. 5327-5343, 2022, DOI:10.32604/cmc.2022.025953

Abstract In this research work, an efficient sign language recognition tool for e-learning has been proposed with a new type of feature set based on angle and lines. This feature set has the ability to increase the overall performance of machine learning algorithms in an efficient way. The hand gesture recognition based on these features has been implemented for usage in real-time. The feature set used hand landmarks, which were generated using media-pipe (MediaPipe) and open computer vision (openCV) on each frame of the incoming video. The overall algorithm has been tested on two well-known ASL-alphabet (American Sign Language) and ISL-HS… More >

Fawad Salam Khan^1,4, Mohd Norzali Haji Mohd^1,*, Saiful Azrin B. M. Zulkifli², Ghulam E Mustafa Abro², Suhail Kazi³, Dur Muhammad Soomro¹

CMC-Computers, Materials & Continua, Vol.72, No.3, pp. 5741-5759, 2022, DOI:10.32604/cmc.2022.024927

Abstract The evident change in the design of the autopilot system produced massive help for the aviation industry and it required frequent upgrades. Reinforcement learning delivers appropriate outcomes when considering a continuous environment where the controlling Unmanned Aerial Vehicle (UAV) required maximum accuracy. In this paper, we designed a hybrid framework, which is based on Reinforcement Learning and Deep Learning where the traditional electronic flight controller is replaced by using 3D hand gestures. The algorithm is designed to take the input from 3D hand gestures and integrate with the Deep Deterministic Policy Gradient (DDPG) to receive the best reward and take… More >

Amal Abdullah Mohammed Alteaimi^1,*, Mohamed Tahar Ben Othman^1,2

CMC-Computers, Materials & Continua, Vol.72, No.1, pp. 577-595, 2022, DOI:10.32604/cmc.2022.023591

Abstract The Hand Gestures Recognition (HGR) System can be employed to facilitate communication between humans and computers instead of using special input and output devices. These devices may complicate communication with computers especially for people with disabilities. Hand gestures can be defined as a natural human-to-human communication method, which also can be used in human-computer interaction. Many researchers developed various techniques and methods that aimed to understand and recognize specific hand gestures by employing one or two machine learning algorithms with a reasonable accuracy. This work aims to develop a powerful hand gesture recognition model with a 100% recognition rate. We… More >

Muneeb Ur Rehman¹, Fawad Ahmed¹, Muhammad Attique Khan², Usman Tariq³, Faisal Abdulaziz Alfouzan⁴, Nouf M. Alzahrani⁵, Jawad Ahmad^6,*

CMC-Computers, Materials & Continua, Vol.70, No.3, pp. 4675-4690, 2022, DOI:10.32604/cmc.2022.019586

Abstract Recognition of dynamic hand gestures in real-time is a difficult task because the system can never know when or from where the gesture starts and ends in a video stream. Many researchers have been working on vision-based gesture recognition due to its various applications. This paper proposes a deep learning architecture based on the combination of a 3D Convolutional Neural Network (3D-CNN) and a Long Short-Term Memory (LSTM) network. The proposed architecture extracts spatial-temporal information from video sequences input while avoiding extensive computation. The 3D-CNN is used for the extraction of spectral and spatial features which are then given to… More >