高级检索
杨昊, 余映. 利用通道注意力与分层残差网络的图像修复[J]. 计算机辅助设计与图形学学报, 2021, 33(5): 671-681. DOI: 10.3724/SP.J.1089.2021.18514
引用本文: 杨昊, 余映. 利用通道注意力与分层残差网络的图像修复[J]. 计算机辅助设计与图形学学报, 2021, 33(5): 671-681. DOI: 10.3724/SP.J.1089.2021.18514
Yang Hao, Yu Ying. Image Inpainting Using Channel Attention and Hierarchical Residual Networks[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(5): 671-681. DOI: 10.3724/SP.J.1089.2021.18514
Citation: Yang Hao, Yu Ying. Image Inpainting Using Channel Attention and Hierarchical Residual Networks[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(5): 671-681. DOI: 10.3724/SP.J.1089.2021.18514

利用通道注意力与分层残差网络的图像修复

Image Inpainting Using Channel Attention and Hierarchical Residual Networks

  • 摘要: 针对现有深度学习图像修复方法对不同尺度特征的感知和表达能力存在不足的问题,提出一种利用多尺度通道注意力与分层残差网络的图像修复模型.首先采用U-Net作为生成器的主干网络,实现对破损图像的编码与解码操作;然后通过在编码器与解码器中分别构建多尺度的分层残差结构,以增强网络提取和表达破损图像特征的能力;最后在编码器与解码器间的跳跃连接中嵌入扩张的多尺度通道注意力模块,以提高模型对编码器中图像低级特征的利用效率.实验结果表明,在人脸、街景等数据集的破损图像修复上,该模型在主观视觉感受和客观评价指标方面均优于其他经典的图像修复方法.

     

    Abstract: Existing deep-learning-based inpainting methods may have some shortcomings in perceiving and presenting image information at multi-scales.For this problem,we proposed an image inpainting model based on multi-scale channel attention and a hierarchical residual backbone network.Firstly,we adopted a U-Net architecture as the generator backbone of our inpainting model to encode and decode the damaged image.Secondly,we built multi-scale hierarchical residual structures in the encoder and decoder respectively,which can improve the ability of the model to extract and express occluded image features.Finally,we designed a dilated multi-scale channel-attention block and inserted it into the skip-connection of the generator.This block can improve the utilization efficiency of low-level features in the encoder.Experimental results show that our model outperforms other classical inpainting approaches in the face,street-view inpainting tasks,both qualitatively and quantitatively.

     

/

返回文章
返回