Rolling Guide Filtering and Non-subsampled Contourlet Transform for Fusion of Visible and Infrared Images

Xiaodong  Wang; Hongyou  Chen

doi:10.6180/jase.202012_23(4).0013

Rolling Guide Filtering and Non-subsampled Contourlet Transform for Fusion of Visible and Infrared Images

Xiaodong Wang¹ and Hongyou Chen This email address is being protected from spambots. You need JavaScript enabled to view it.¹

¹School of Electrical Engineering, Zhengzhou University of Science and Technology Zhengzhou 450000,China

Received: June 29, 2020
Accepted: July 10, 2020
Publication Date: December 1, 2020

Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Download Citation: ||https://doi.org/10.6180/jase.202012_23(4).0013

ABSTRACT

Image fusion is essentially an image enhancement technology, which aims to generate fusion images with richer information and more features by extracting complementary information from images collected by different sensors (such as infrared and visible light) or the same sensor (such as multi-focus image). For the fusion of infrared and visible images, it is easy to produce problems such as missing detail information and suppressing less noise. In this paper, we propose a Visible and Infrared Images fusion method by combining Non-subsampled Contourlet Transform (NSCT) and rolling guide filtering. First, fuzzy logic algorithm is used to enhance the contrast of visible image and highlight the effective information of image. Second, the enhanced visible and infrared images are decomposed by NSCT to obtain the low frequency and high frequency sub-bands. The improved rolling guide filter is used to enhance the edge and other details of the high frequency sub-band of infrared image. Third, mean gradient strategy and fuzzy logic strategy are used to fuse high and low frequency sub-bands, respectively. Experiments show that the proposed fusion method has better results than other state-of-the-art methods in terms of information entropy, standard deviation, and mutual information.

Keywords: Image fusion; NSCT; Rolling guide ﬁltering; Fuzzy logic algorithm

REFERENCES

[1]Shoulin Y, Ye Z. “Singular value decomposition-based anisotropic diffusion for fusion of infrared and visible images”, International Journal of Image and Data Fusion, pp: 146-163 (2018). doi: 10.1080/19479832.2018.1487886
[2]Chen, H.-J. Feng, Z.-H. Xu, et al. “Fast detail-preserving exposure fusion”, Journal of Zhejiang University, 49(6), pp:1048-1054, (2015). doi: 10.3785/j.issn.1008-973X.2015.06.007
[3]Kuo Chen, Yueting Chen, Huajun Feng, et al. “Detail Preserving Exposure Fusion for a Dual Sensor Camera”, Optical Review, 21(6), pp: 769-774, (2014). doi: 10.1007/s10043-014-0126-6
[4]Teng Lin, Hang Li and Shoulin Yin. “Modified Pyramid Dual Tree Direction Filter-based Image De-noising via Curvature Scale and Non-local mean multi-Grade remnant multi-Grade Remnant Filter”, International Journal of Communication Systems. 31(16), (2018). doi: 10.1002/dac.3486
[5]Do M N, Vetterli M. “The Contourlet Transform: An Efficient Directional Multiresolution Image Representation”, IEEE Transactions on Image Processing, 14(12), pp:2091-2106 (2006). doi: 10.1109/tip.2005.859376
[6]Da Cunha A L, Zhou J, Do M N. “The Nonsubsampled Contourlet Transform: Theory, Design, and Applications”, IEEE Transactions on Image Processing, 15(10), pp.3089-3101, (2006). doi: 10.1109/TIP.2006.877507
[7]Li S, Kang X, Hu J. “Image Fusion With Guided Filtering”, IEEE Transactions on Image Processing, 22(7), pp. 2864-2875, (2013). doi: 10.1109/TIP.2013.2244222
[8]Li H, Liu L, Huang W, et al. “An improved fusion algorithm for infrared and visible images based on multi-scale transform,” Infrared Physics & Technology, 74, pp. 28-37, 2016. doi: 10.1016/j.infrared.2015.11.002
[9]Xiao X, Xie J, Niu J, et al. “A Novel Image Fusion Method for Water Body Extraction Based on Optimal Band Combination,” Traitement du Signal, 37(2), pp.195-207, 2020. doi: 10.18280/ts.370205
[10]Yu and X. Chen, "Infrared and Visible Image Fusion Based on a Latent Low-Rank Representation Nested With Multiscale Geometric Transform," IEEE Access, vol. 8, pp. 110214-110226, 2020. doi: 10.1109/ACCESS.2020.3001974.
[11]Wang Y, Yang Y, Dang J. “Image fusion ijased on fuzzy logic combined with adaptive pulse coupled neural network in nonsubsampled contourlet transform domain,” Laser & Optoelectronics Progress, 56(9), 2019. doi: 10.3788/LQP56.101006
[12]Khamparia A, Pandey B, Pandey D K, et al. “Comparison of RSM, ANN and Fuzzy Logic for extraction of Oleonolic Acid from Ocimum sanctum,” Computers in Industry, 117:103200, (2020). doi: 10.1016/j.compind.2020.103200
[13]Wang Yan, Yang Yanchun, Dang Jianwu, et al. “Image Fusion Based on Fuzzy Logic Combined with Adaptive Pulse Coupled Neural Network in Nonsubsampled Contourlet Transform Domain,” Laser & Optoelectronics Progress, 56(10):101006, (2019). doi: 10.3788/LOP56.101006
[14]Li Z, Zheng J, Zhu Z, et al. “Weighted Guided Image Filtering,” IEEE Transactions on Image Processing, 24(1):120-129, (2015). doi: 10.1109/TIP.2014.2371234
[15]Li, J., Feng, L. “Rolling Guidance Filtering-Orientated Saliency Region Extraction Method for Visible and Infrared Images Fusion”, Sensing and Imaging, 21(18), (2020). doi:10.1007/s11220-020-00282-7
[16]Wang Z, Xu J, Jiang X, et al. “Infrared and visible image fusion via hybrid decomposition of NSCT and morphological sequential toggle operator,” Optik International Journal for Light & Electron Optics, 201:163497, 2019. doi: 10.1016/j.ijleo.2019.163497
[17]Dai Jindun, Liu Yadong, Mao Xianyin, et al. “Infrared and visible image fusion based on FDST and dual-channel PCNN”, Infrared and Laser Engineering, 48(2):204001, (2019). doi: 10.3788/IRLA201948.0204001
[18]Li J, Huo H T, Li C, et al. “AttentionFGAN: Infrared and Visible Image Fusion using Attention-based Generative Adversarial Networks,” IEEE Transactions on Multimedia, (2020). doi: 10.1109/TMM.2020.2997127