Open Access iconOpen Access



Infrared and Visible Image Fusion Based on NSST and RDN

Peizhou Yan1, Jiancheng Zou2,*, Zhengzheng Li1, Xin Yang3

1 College of Electrical and Control Engineering, North China University of Technology, Beijing, 100043, China
2 College of Sciences, North China University of Technology, Beijing, 100043, China
3 Department of Computer Science, Middle Tennessee State University, Murfreesboro, 37132, USA

* Corresponding Author: Jiancheng Zou. Email: email

Intelligent Automation & Soft Computing 2021, 28(1), 213-225.


Within the application of driving assistance systems, the detection of driver’s facial features in the cab for a spectrum of luminosities is mission critical. One method that addresses this concern is infrared and visible image fusion. Its purpose is to generate an aggregate image which can granularly and systematically illustrate scene details in a range of lighting conditions. Our study introduces a novel approach to this method with marked improvements. We utilize non-subsampled shearlet transform (NSST) to obtain the low and high frequency sub-bands of infrared and visible imagery. For the low frequency sub-band fusion, we incorporate the local average energy and standard deviation. In the high frequency sub-band, a residual dense network is applied for multiscale feature extraction to generate high frequency sub-band feature maps. We then employ the maximum weighted average algorithm to achieve high frequency sub-band fusion. Finally, we transform the fused low frequency and high frequency sub-bands by inverse NSST. The results of the experiment and application in real world driving scenarios proved that this method showed excellent performance when objectively compared to the indexing from the other contemporary, industry standard algorithms. In particular, the subjective visual effect, fine texture, and scene were fully expressed, the target’s edge distinct was pronounced, and the detailed information of the source image was exhaustively captured.


Cite This Article

P. Yan, J. Zou, Z. Li and X. Yang, "Infrared and visible image fusion based on nsst and rdn," Intelligent Automation & Soft Computing, vol. 28, no.1, pp. 213–225, 2021.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1586


  • 1032


  • 0


Share Link