高级检索
邢晓敏, 刘威. 二阶段端到端的图像去雾生成网络[J]. 计算机辅助设计与图形学学报, 2020, 32(1): 164-172. DOI: 10.3724/SP.J.1089.2020.17856
引用本文: 邢晓敏, 刘威. 二阶段端到端的图像去雾生成网络[J]. 计算机辅助设计与图形学学报, 2020, 32(1): 164-172. DOI: 10.3724/SP.J.1089.2020.17856
Xing Xiaomin, Liu Wei. Two Stages End-to-End Generative Network for Single Image Defogging[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(1): 164-172. DOI: 10.3724/SP.J.1089.2020.17856
Citation: Xing Xiaomin, Liu Wei. Two Stages End-to-End Generative Network for Single Image Defogging[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(1): 164-172. DOI: 10.3724/SP.J.1089.2020.17856

二阶段端到端的图像去雾生成网络

Two Stages End-to-End Generative Network for Single Image Defogging

  • 摘要: 单幅雾天图像的恢复是计算机视觉领域的一个基础问题,现有的方法主要包括基于先验信息的去雾方法和基于学习的去雾方法.然而,在实践中,前者具有很强的假设先验,导致该类方法的应用场景具有一定的局限性;后者在获取大量的配对数据上很困难.针对这2类问题,提出一种基于非配对数据训练的二阶段端到端的自适应去雾生成网络,其基于循环生成式对抗网络框架,不同的是,在训练的过程中,提出一种二阶段映射策略.首先通过一级映射网络得到去雾结果;然后将该结果作为二级映射网络的输入,进一步提高去雾效果.另外,提出一种循环增强损失函数,并引入了先验信息约束生成器之间的映射关系.采用室内外多场景下的仿真雾图和真实雾图作为测试数据,通过全参考和无参考图像质量评价指标进行对比分析;实验结果表明,该方法不仅能够更好地适应处理各类雾天场景,有效地提高图像的峰值信噪比和结构相似度,且较好地复原了退化场景的边缘信息和色彩信息.

     

    Abstract: Single image defogging is a fundamental problem in computer vision.Among the existing method,they are mainly divided into two categories,including prior-based methods and learning-based methods.In practice,however,the prior-based method may fail due to their strong assumed constraint information,and the learning methods are hard to train due to extremely difficult to obtain the paired training data.To avoid those problems,this paper has proposed an end-to-end learning framework to remove the fog from a single foggy image by using the unpaired fog-fogfree dataset,adversarial discriminators and cycle consistent loss function.Our method is based on the framework of cycle generative adversarial network(CycleGAN).Different from one-stage mapping strategy in CycleGAN,we use a two-stage mapping strategy in each module to strength the mapping function to recover a cleaner image.In order to preserve the texture information,we have introduced the prior knowledge to constrain the generators.The synthetic and real-world foggy images are used as our test dataset.On these images,we exploit the full-reference and no-reference image quality assessment methods to compare each defogging methods.Experimental results demonstrate that the proposed method can better deal with much more kinds of foggy scenes,and the generated results have better peak signal to noise ratio and structural similarity than traditional methods.Moreover,our results have more vivid color information and detailed edge texture information.

     

/

返回文章
返回