Open Access iconOpen Access

ARTICLE

Microphone Array-Based Sound Source Localization Using Convolutional Residual Network

Ziyi Wang1, Xiaoyan Zhao1,*, Hongjun Rong1, Ying Tong1, Jingang Shi2

1 School of Information and Communication Engineering, Nanjing Institute of Technology, Nanjing, 211167, China
2 University of Oulu, Oulu, 90014, FI, Finland

* Corresponding Author: Xiaoyan Zhao. Email: email

Journal of New Media 2022, 4(3), 145-153. https://doi.org/10.32604/jnm.2022.030178

Abstract

Microphone array-based sound source localization (SSL) is widely used in a variety of occasions such as video conferencing, robotic hearing, speech enhancement, speech recognition and so on. The traditional SSL methods cannot achieve satisfactory performance in adverse noisy and reverberant environments. In order to improve localization performance, a novel SSL algorithm using convolutional residual network (CRN) is proposed in this paper. The spatial features including time difference of arrivals (TDOAs) between microphone pairs and steered response power-phase transform (SRP-PHAT) spatial spectrum are extracted in each Gammatone sub-band. The spatial features of different sub-bands with a frame are combine into a feature matrix as the input of CRN. The proposed algorithm employ CRN to fuse the spatial features. Since the CRN introduces the residual structure on the basis of the convolutional network, it reduce the difficulty of training procedure and accelerate the convergence of the model. A CRN model is learned from the training data in various reverberation and noise environments to establish the mapping regularity between the input feature and the sound azimuth. Through simulation verification, compared with the methods using traditional deep neural network, the proposed algorithm can achieve a better localization performance in SSL task, and provide better generalization capacity to untrained noise and reverberation.

Keywords


Cite This Article

Z. Wang, X. Zhao, H. Rong, Y. Tong and J. Shi, "Microphone array-based sound source localization using convolutional residual network," Journal of New Media, vol. 4, no.3, pp. 145–153, 2022.



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1061

    View

  • 641

    Download

  • 0

    Like

Share Link