Saiyed Umer^1,*, Ranjeet Kumar Rout², Shailendra Tiwari³, Ahmad Ali AlZubi⁴, Jazem Mutared Alanazi⁴, Kulakov Yurii⁵

CMES-Computer Modeling in Engineering & Sciences, Vol.135, No.2, pp. 1165-1185, 2023, DOI:10.32604/cmes.2022.023312

Abstract A deep fusion model is proposed for facial expression-based human-computer Interaction system. Initially, image preprocessing, i.e., the extraction of the facial region from the input image is utilized. Thereafter, the extraction of more discriminative and distinctive deep learning features is achieved using extracted facial regions. To prevent overfitting, in-depth features of facial images are extracted and assigned to the proposed convolutional neural network (CNN) models. Various CNN models are then trained. Finally, the performance of each CNN model is fused to obtain the final decision for the seven basic classes of facial expressions, i.e., fear, disgust, anger, surprise, sadness, happiness,… More >

Hyun-Sam Shin¹, Jun-Ki Hong^2,*

Intelligent Automation & Soft Computing, Vol.36, No.1, pp. 235-248, 2023, DOI:10.32604/iasc.2023.033082

Abstract Recently, artificial-intelligence-based automatic customer response system has been widely used instead of customer service representatives. Therefore, it is important for automatic customer service to promptly recognize emotions in a customer’s voice to provide the appropriate service accordingly. Therefore, we analyzed the performance of the emotion recognition (ER) accuracy as a function of the simulation time using the proposed chunk-based speech ER (CSER) model. The proposed CSER model divides voice signals into 3-s long chunks to efficiently recognize characteristically inherent emotions in the customer’s voice. We evaluated the performance of the ER of voice signal chunks by applying four RNN techniques—long… More >

Mohammad Amaz Uddin¹, Mohammad Salah Uddin Chowdury¹, Mayeen Uddin Khandaker^2,*, Nissren Tamam³, Abdelmoneim Sulieman⁴

CMC-Computers, Materials & Continua, Vol.74, No.1, pp. 1709-1722, 2023, DOI:10.32604/cmc.2023.031177

Abstract Human speech indirectly represents the mental state or emotion of others. The use of Artificial Intelligence (AI)-based techniques may bring revolution in this modern era by recognizing emotion from speech. In this study, we introduced a robust method for emotion recognition from human speech using a well-performed preprocessing technique together with the deep learning-based mixed model consisting of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN). About 2800 audio files were extracted from the Toronto emotional speech set (TESS) database for this study. A high pass and Savitzky Golay Filter have been used to obtain noise-free as well as… More >

Sandeep Kumar¹, MohdAnul Haq², Arpit Jain³, C. Andy Jason⁴, Nageswara Rao Moparthi¹, Nitin Mittal⁵, Zamil S. Alzamil^2,*

CMC-Computers, Materials & Continua, Vol.74, No.1, pp. 1523-1540, 2023, DOI:10.32604/cmc.2023.028631

Abstract Day by day, biometric-based systems play a vital role in our daily lives. This paper proposed an intelligent assistant intended to identify emotions via voice message. A biometric system has been developed to detect human emotions based on voice recognition and control a few electronic peripherals for alert actions. This proposed smart assistant aims to provide a support to the people through buzzer and light emitting diodes (LED) alert signals and it also keep track of the places like households, hospitals and remote areas, etc. The proposed approach is able to detect seven emotions: worry, surprise, neutral, sadness, happiness, hate… More >

Jodi L. Feinberg¹, Peter Sheng², Stephanie Pena², Adam J. Small¹, Susanna Wendelboe¹, Katlyn Nemani³, Vikram Agrawal⁴, Dan G. Halpern^1,*

Congenital Heart Disease, Vol.17, No.5, pp. 519-531, 2022, DOI:10.32604/chd.2022.024174

Abstract Background: Adults with congenital heart disease (ACHD) have increased prevalence of mood and anxiety disorders. There are limited data regarding the influence of the COVID-19 pandemic on the mental health and health behaviors of these patients. Objective: The purpose is to evaluate the perceptions, emotions, and health behaviors of ACHD patients during the COVID-19 pandemic. Methods: In this cross-sectional study of ACHD patients, we administered surveys evaluating self-reported emotions, perceptions and health behaviors. Logistic regressions were performed to determine the adjusted odds of displaying each perception, emotion and health behavior based on predictor variables. Results: Ninety-seven patients (mean age 38.3… More > Graphic Abstract

Mohamed Ezz¹, Ayman Mohamed Mostafa^1,*, Ayman Elshenawy^2,3

Intelligent Automation & Soft Computing, Vol.35, No.3, pp. 3659-3675, 2023, DOI:10.32604/iasc.2023.031561

Abstract Face authentication is an important biometric authentication method commonly used in security applications. It is vulnerable to different types of attacks that use authorized users’ facial images and videos captured from social media to perform spoofing attacks and dynamic movements for penetrating security applications. This paper presents an innovative challenge-response emotions authentication model based on the horizontal ensemble technique. The proposed model provides high accurate face authentication process by challenging the authorized user using a random sequence of emotions to provide a specific response for every authentication trial with a different sequence of emotions. The proposed model is applied to… More >

R. Punithavathi^1,*, S. Thenmozhi², R. Jothilakshmi³, V. Ellappan⁴, Islam Md Tahzib Ul⁵

Computer Systems Science and Engineering, Vol.45, No.1, pp. 247-261, 2023, DOI:10.32604/csse.2023.025972

Abstract During Covid pandemic, many individuals are suffering from suicidal ideation in the world. Social distancing and quarantining, affects the patient emotionally. Affective computing is the study of recognizing human feelings and emotions. This technology can be used effectively during pandemic for facial expression recognition which automatically extracts the features from the human face. Monitoring system plays a very important role to detect the patient condition and to recognize the patterns of expression from the safest distance. In this paper, a new method is proposed for emotion recognition and suicide ideation detection in COVID patients. This helps to alert the nurse,… More >

Abdullah A Asiri¹, Akhtar Badshah², Fazal Muhammad^3,*, Hassan A Alshamrani¹, Khalil Ullah⁴, Khalaf A Alshamrani¹, Samar Alqhtani⁵, Muhammad Irfan⁶, Hanan Talal Halawani⁷, Khlood M Mehdar⁸

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 5075-5089, 2022, DOI:10.32604/cmc.2022.031156

Abstract Electroencephalogram (EEG) is a medical imaging technology that can measure the electrical activity of the scalp produced by the brain, measured and recorded chronologically the surface of the scalp from the brain. The recorded signals from the brain are rich with useful information. The inference of this useful information is a challenging task. This paper aims to process the EEG signals for the recognition of human emotions specifically happiness, anger, fear, sadness, and surprise in response to audiovisual stimuli. The EEG signals are recorded by placing neurosky mindwave headset on the subject’s scalp, in response to audiovisual stimuli for the… More >

Zia Ullah¹, Muhammad Ismail Mohmand¹, Sadaqat ur Rehman^2,*, Muhammad Zubair³, Maha Driss⁴, Wadii Boulila⁵, Rayan Sheikh², Ibrahim Alwawi⁶

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 4465-4487, 2022, DOI:10.32604/cmc.2022.029101

Abstract Facial expression recognition has been a hot topic for decades, but high intraclass variation makes it challenging. To overcome intraclass variation for visual recognition, we introduce a novel fusion methodology, in which the proposed model first extract features followed by feature fusion. Specifically, RestNet-50, VGG-19, and Inception-V3 is used to ensure feature learning followed by feature fusion. Finally, the three feature extraction models are utilized using Ensemble Learning techniques for final expression classification. The representation learnt by the proposed methodology is robust to occlusions and pose variations and offers promising accuracy. To evaluate the efficiency of the proposed model, we… More >

Ng Lai Yee¹, Mohd Asyraf Zulkifley^2,*, Adhi Harmoko Saputro³, Siti Raihanah Abdani⁴

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 5331-5348, 2022, DOI:10.32604/cmc.2022.028801

Abstract Micro-expression is manifested through subtle and brief facial movements that relay the genuine person’s hidden emotion. In a sequence of videos, there is a frame that captures the maximum facial differences, which is called the apex frame. Therefore, apex frame spotting is a crucial sub-module in a micro-expression recognition system. However, this spotting task is very challenging due to the characteristics of micro-expression that occurs in a short duration with low-intensity muscle movements. Moreover, most of the existing automated works face difficulties in differentiating micro-expressions from other facial movements. Therefore, this paper presents a deep learning model with an attention… More >