Vol.73, No.2, 2022, pp.4349-4367, doi:10.32604/cmc.2022.028251
Automated Speech Recognition System to Detect Babies’ Feelings through Feature Analysis
  • Sana Yasin1, Umar Draz2,3,*, Tariq Ali4, Kashaf Shahid1, Amna Abid1, Rukhsana Bibi1, Muhammad Irfan5, Mohammed A. Huneif6, Sultan A. Almedhesh6, Seham M. Alqahtani6, Alqahtani Abdulwahab6, Mohammed Jamaan Alzahrani6, Dhafer Batti Alshehri6, Alshehri Ali Abdullah7, Saifur Rahman5
1 Faculty of Computing, University of Okara, Okara, 57000, Pakistan
2 Department of Computer Science, University of Sahiwal, Sahiwal, 57000, Punjab, Pakistan
3 Computer Science Department, COMSATS University Islamabad, Lahore Campus, 57000, Pakistan
4 Department of Computer Science, CUI, Sahiwal Campus, Sahiwal, 57000, Pakistan
5 Electrical Engineering Department, College of Engineering, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia
6 Pediatric Department, Medical College, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia
7 Consultant of ORL&HNs and Facial Plastic Surgery, College of Medicine, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia
* Corresponding Author: Umar Draz. Email:
Received 06 February 2022; Accepted 13 May 2022; Issue published 16 June 2022
Diagnosing a baby’s feelings poses a challenge for both doctors and parents because babies cannot explain their feelings through expression or speech. Understanding the emotions of babies and their associated expressions during different sensations such as hunger, pain, etc., is a complicated task. In infancy, all communication and feelings are propagated through cry-speech, which is a natural phenomenon. Several clinical methods can be used to diagnose a baby’s diseases, but nonclinical methods of diagnosing a baby’s feelings are lacking. As such, in this study, we aimed to identify babies’ feelings and emotions through their cry using a nonclinical method. Changes in the cry sound can be identified using our method and used to assess the baby’s feelings. We considered the frequency of the cries from the energy of the sound. The feelings represented by the infant’s cry are judged to represent certain sensations expressed by the child using the optimal frequency of the recognition of a real-world audio sound. We used machine learning and artificial intelligence to distinguish cry tones in real time through feature analysis. The experimental group consisted of 50% each male and female babies, and we determined the relevancy of the results against different parameters. This application produced real-time results after recognizing a child’s cry sounds. The novelty of our work is that we, for the first time, successfully derived the feelings of young children through the cry-speech of the child, showing promise for end-user applications.
Cry-to-speak; machine learning; artificial intelligence; cry speech detection; babies
Cite This Article
S. Yasin, U. Draz, T. Ali, K. Shahid, A. Abid et al., "Automated speech recognition system to detect babies’ feelings through feature analysis," Computers, Materials & Continua, vol. 73, no.2, pp. 4349–4367, 2022.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.