Open Access iconOpen Access

ARTICLE

Deep Learning-based Environmental Sound Classification Using Feature Fusion and Data Enhancement

Rashid Jahangir1,*, Muhammad Asif Nauman2, Roobaea Alroobaea3, Jasem Almotiri3, Muhammad Mohsin Malik1, Sabah M. Alzahrani3

1 Department of Computer Science, COMSATS University Islamabad, Vehari Campus, Pakistan
2 Department of Computer Science, University of Engineering and Technology Lahore, Pakistan
3 Department of Computer Science, College of Computers and Information Technology, Taif University, Taif, 21974, Saudi Arabia

* Corresponding Author: Rashid Jahangir. Email: email

Computers, Materials & Continua 2023, 74(1), 1069-1091. https://doi.org/10.32604/cmc.2023.032719

Abstract

Environmental sound classification (ESC) involves the process of distinguishing an audio stream associated with numerous environmental sounds. Some common aspects such as the framework difference, overlapping of different sound events, and the presence of various sound sources during recording make the ESC task much more complicated and complex. This research is to propose a deep learning model to improve the recognition rate of environmental sounds and reduce the model training time under limited computation resources. In this research, the performance of transformer and convolutional neural networks (CNN) are investigated. Seven audio features, chromagram, Mel-spectrogram, tonnetz, Mel-Frequency Cepstral Coefficients (MFCCs), delta MFCCs, delta-delta MFCCs and spectral contrast, are extracted from the UrbanSound8K, ESC-50, and ESC-10, databases. Moreover, this research also employed three data enhancement methods, namely, white noise, pitch tuning, and time stretch to reduce the risk of overfitting issue due to the limited audio clips. The evaluation of various experiments demonstrates that the best performance was achieved by the proposed transformer model using seven audio features on enhanced database. For UrbanSound8K, ESC-50, and ESC-10, the highest attained accuracies are 0.98, 0.94, and 0.97 respectively. The experimental results reveal that the proposed technique can achieve the best performance for ESC problems.

Keywords


Cite This Article

APA Style
Jahangir, R., Nauman, M.A., Alroobaea, R., Almotiri, J., Malik, M.M. et al. (2023). Deep learning-based environmental sound classification using feature fusion and data enhancement. Computers, Materials & Continua, 74(1), 1069-1091. https://doi.org/10.32604/cmc.2023.032719
Vancouver Style
Jahangir R, Nauman MA, Alroobaea R, Almotiri J, Malik MM, Alzahrani SM. Deep learning-based environmental sound classification using feature fusion and data enhancement. Comput Mater Contin. 2023;74(1):1069-1091 https://doi.org/10.32604/cmc.2023.032719
IEEE Style
R. Jahangir, M.A. Nauman, R. Alroobaea, J. Almotiri, M.M. Malik, and S.M. Alzahrani, “Deep Learning-based Environmental Sound Classification Using Feature Fusion and Data Enhancement,” Comput. Mater. Contin., vol. 74, no. 1, pp. 1069-1091, 2023. https://doi.org/10.32604/cmc.2023.032719



cc Copyright © 2023 The Author(s). Published by Tech Science Press.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1116

    View

  • 834

    Download

  • 1

    Like

Share Link