高级检索
谢强强, 张海, 盖杉. 多分辨率上下文聚合网络的单幅图像去雨方法[J]. 计算机辅助设计与图形学学报, 2022, 34(2): 232-244. DOI: 10.3724/SP.J.1089.2022.18887
引用本文: 谢强强, 张海, 盖杉. 多分辨率上下文聚合网络的单幅图像去雨方法[J]. 计算机辅助设计与图形学学报, 2022, 34(2): 232-244. DOI: 10.3724/SP.J.1089.2022.18887
Xie Qiangqiang, Zhang Hai, Gai Shan. Multi-Resolution Context Aggregation Network for Single Image Rain Removal[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(2): 232-244. DOI: 10.3724/SP.J.1089.2022.18887
Citation: Xie Qiangqiang, Zhang Hai, Gai Shan. Multi-Resolution Context Aggregation Network for Single Image Rain Removal[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(2): 232-244. DOI: 10.3724/SP.J.1089.2022.18887

多分辨率上下文聚合网络的单幅图像去雨方法

Multi-Resolution Context Aggregation Network for Single Image Rain Removal

  • 摘要: 雨天等恶劣天气将造成图像质量的严重退化,进而影响计算机视觉算法的准确性.为了更好地提取多尺度雨痕特征,恢复图像含有的重要细节信息,提出一种基于多分辨率上下文聚合网络的单幅图像去雨方法.首先利用混洗操作将单一分辨率输入图像转化为多空间分辨率的输入图像,在低空间分辨率中使网络迅速扩大接受场,而在高空间分辨率下提取更加精细的雨痕特征,并将低分辨率提取的雨痕特征自上而下地聚合到高空间分辨率中,引导网络提取多尺度雨痕信息;然后采用多分辨率特征增强块细化不同分辨率下图像的细节,防止去雨图像中的细节损失或模糊,利用局部残差密集连接和挤压-激励网络增强网络的特征提取能力和效率;最后采用构造的混合损失函数,在获取较高评价指标数值的同时提高人类对去雨图像的视觉感知.实验结果表明,所提方法在Rain100H,Rain100L, Rain12合成数据集和真实雨数据集上取得显著的去雨效果,与现有方法比较,该方法的定性指标和定量指标得到明显提升,具有较高的细节保持度.

     

    Abstract: Severe weather such as rain will cause serious degradation of image quality and affect the accuracy of computer vision algorithms. In order to better extract the features of multi-scale rain streaks and restore the important detailed feature information of the image, a new single image rain removal based on multi-resolution context aggregation network is proposed. Firstly, the shuffling operation is used to convert a single resolution input image into a multi-spatial resolution input, which enables the network to rapidly expand the acceptance field at the low spatial resolution and extract more refined rain streak features at high spatial resolution. The low-resolution rain streak features are aggregated from top to bottom into high spatial resolution, and the network is guided to extract multi-scale rain streak information. Secondly, the multi-resolution feature enhancement block is used to refine the details of the image at different resolutions to prevent the loss or blurring of the details in the rain-removed image. This method uses local residual densely connect blocks and squeeze-excitation network to enhance the ability and efficiency of the network to extract features. Finally, the mixed loss function constructed in this paper is used to obtain higher evaluation index values while improving the human visual perception of rain removal images. The experimental results show that proposed method achieves significant rain removal effects on the Rain100H, Rain100L, and Rain12 synthetic datasets and real rain datasets. Compared with the existing algorithms, the proposed method can achieve significant improvement in qualitative and quantitative indicators and has a high degree of detail retention.

     

/

返回文章
返回