Infrared and Visible Image Fusion based on Dual-path and Dual-discriminator Generation Adversarial Network

Aiming at the problem that the image fusion algorithms cannot preserve more information from the source images and are not rich enough in details, an infrared and visible image fusion method based on dual-path and dual-discriminator generation adversarial network (GAN) is proposed. In the generator, the gradient path and contrast path based on the difference connection of source images are constructed to improve the detail information and contrast of the fused images. the multi-scale decomposition is used to extract feature information from infrared and visible images and solve the problem of incomplete feature extraction on a single scale. Then, two source images are directly introduced into each layer of the dual-path dense connection network. As a result, the efficiency of feature transmission is improved, meanwhile obtaining more source image information. In the discriminator, to avoid the modal imbalance caused by the loss of contrast information in the single discriminator, double discriminators are used to estimate the region distribution of source images. The main-auxiliary gradient and main-auxiliary strength loss functions are constructed to improve the information extraction capability of the network model. Comparison experiments on three standard fusion data sets show that the proposed algorithm not only provides the best fusion results in multiple objective evaluation indicators, but also has better visual effect.