高级检索
吕品, 邓东平, 石铁柱, 王梦迪, 刘潜, 田雨, 张紫红, 曾赟, 邬国峰. 基于幸运成像和生成对抗网络的湍流图像复原算法[J]. 计算机辅助设计与图形学学报. DOI: 10.3724/SP.J.1089.2023-00035
引用本文: 吕品, 邓东平, 石铁柱, 王梦迪, 刘潜, 田雨, 张紫红, 曾赟, 邬国峰. 基于幸运成像和生成对抗网络的湍流图像复原算法[J]. 计算机辅助设计与图形学学报. DOI: 10.3724/SP.J.1089.2023-00035
Pin LV, Dongping DENG, Tiezhu SHI, Mengdi WANG, Qian LIU, Yu TIAN, Zihong ZHANG , Yun Zeng, Guofeng WU. Atmospheric Turbulence Image Recovery Algorithm Based on Lucky Imaging and Generative Adversarial Networks[J]. Journal of Computer-Aided Design & Computer Graphics. DOI: 10.3724/SP.J.1089.2023-00035
Citation: Pin LV, Dongping DENG, Tiezhu SHI, Mengdi WANG, Qian LIU, Yu TIAN, Zihong ZHANG , Yun Zeng, Guofeng WU. Atmospheric Turbulence Image Recovery Algorithm Based on Lucky Imaging and Generative Adversarial Networks[J]. Journal of Computer-Aided Design & Computer Graphics. DOI: 10.3724/SP.J.1089.2023-00035

基于幸运成像和生成对抗网络的湍流图像复原算法

Atmospheric Turbulence Image Recovery Algorithm Based on Lucky Imaging and Generative Adversarial Networks

  • 摘要: 在拍摄远距离目标时,视频序列图像受到大气湍流的影响从而产生畸变和模糊,为对视频序列大气湍流退化图像进行复原,本文提出了一种幸运成像与生成对抗网络相结合的算法。本文采用空域幸运成像算法,在有限的视频序列图像中挑选出幸运区域,拼接-排序后进行叠加,从而消除大气湍流带来的几何畸变,在此基础上引入DeblurGAN-v2模型进一步提升图像质量。本文将高速相机拍摄的真实湍流退化图像作为研究对象,采用本文提出的方法进行实验,并与图像重采样、灰度变换和巴特沃斯高通滤波算法进行对比,并通过客观评价指标对不同算法的结果进行评估。实验结果表明,本文方法的Brenner梯度函数、Laplacian梯度函数、灰度差分函数(SMD)、熵函数(Entropy)、能量梯度函数(Energy)、PIQE以及Brisque指标相较于其他方法分别提升了291%、66%、127%、10%、74%和159%。从主观效果上看,幸运成像与生成对抗网络相结合的算法能显著提高图像的视觉质量,有效降低图像的模糊和几何畸变程度。

     

    Abstract: In order to restore the degraded images of atmospheric turbulence in video sequences, an algorithm combining Lucky Imaging and Generative Adversarial Network(GAN) is proposed in order to restore the degraded images of atmospheric turbulence in video sequences. In this paper, the spatial lucky imaging algorithm is used to select the lucky regions in the limited video sequence images, and superimpose them after stitching-sorting, so as to eliminate the geometric distortion caused by atmospheric turbulence, and on this basis, the DeblurGAN-v2 model is introduced to further improve the image quality. In this paper, the real turbulence degradation image taken by the high-speed camera is taken as the research object, and the method proposed in this paper is used to carry out experiments, and compared with the image resampling, grayscale transformation and Butterworth high-pass filtering algorithms, and the results of different algorithms are evaluated by objective evaluation indicators. The experimental results show that the Brenner gradient function, Laplacian gradient function, SMD, Entropy, Energy, PIQE and Brisque indicators of this method are improved by 291%, 66%, 127%, 10%, 74% and 159% compared with other methods, respectively. From the subjective effect, the algorithm combining Lucky Imaging and GAN can significantly improve the visual quality of the image and effectively reduce the degree of blur and geometric distortion of the image.

     

/

返回文章
返回