Open Access

ARTICLE

Infrared and Visible Image Fusion Based on NSST and RDN

Peizhou Yan¹, Jiancheng Zou^2,*, Zhengzheng Li¹, Xin Yang³

1 College of Electrical and Control Engineering, North China University of Technology, Beijing, 100043, China
2 College of Sciences, North China University of Technology, Beijing, 100043, China
3 Department of Computer Science, Middle Tennessee State University, Murfreesboro, 37132, USA

* Corresponding Author: Jiancheng Zou. Email:

Intelligent Automation & Soft Computing 2021, 28(1), 213-225. https://doi.org/10.32604/iasc.2021.016201

Received 26 December 2020; Accepted 26 January 2021; Issue published 17 March 2021

Abstract

Within the application of driving assistance systems, the detection of driver’s facial features in the cab for a spectrum of luminosities is mission critical. One method that addresses this concern is infrared and visible image fusion. Its purpose is to generate an aggregate image which can granularly and systematically illustrate scene details in a range of lighting conditions. Our study introduces a novel approach to this method with marked improvements. We utilize non-subsampled shearlet transform (NSST) to obtain the low and high frequency sub-bands of infrared and visible imagery. For the low frequency sub-band fusion, we incorporate the local average energy and standard deviation. In the high frequency sub-band, a residual dense network is applied for multiscale feature extraction to generate high frequency sub-band feature maps. We then employ the maximum weighted average algorithm to achieve high frequency sub-band fusion. Finally, we transform the fused low frequency and high frequency sub-bands by inverse NSST. The results of the experiment and application in real world driving scenarios proved that this method showed excellent performance when objectively compared to the indexing from the other contemporary, industry standard algorithms. In particular, the subjective visual effect, fine texture, and scene were fully expressed, the target’s edge distinct was pronounced, and the detailed information of the source image was exhaustively captured.

---

Keywords

---