高级检索
彭豪, 李晓明. 利用金字塔空间注意力与特征推理的图像修复[J]. 计算机辅助设计与图形学学报, 2023, 35(1): 87-98. DOI: 10.3724/SP.J.1089.2023.19274
引用本文: 彭豪, 李晓明. 利用金字塔空间注意力与特征推理的图像修复[J]. 计算机辅助设计与图形学学报, 2023, 35(1): 87-98. DOI: 10.3724/SP.J.1089.2023.19274
PENG Hao, LI Xiao-ming. Image Inpainting Using Pyramid Spatial Attention and Feature Reasoning[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(1): 87-98. DOI: 10.3724/SP.J.1089.2023.19274
Citation: PENG Hao, LI Xiao-ming. Image Inpainting Using Pyramid Spatial Attention and Feature Reasoning[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(1): 87-98. DOI: 10.3724/SP.J.1089.2023.19274

利用金字塔空间注意力与特征推理的图像修复

Image Inpainting Using Pyramid Spatial Attention and Feature Reasoning

  • 摘要: 针对现有基于深度学习的图像修复方法对图像未受损区域多尺度特征空间信息利用不足的问题,提出一种利用金字塔空间注意力与特征推理的图像修复模型.首先,采用基于部分卷积的区域识别模块,用于识别本次循环中需要推理的区域,其次,通过循环特征推理模块高效地推理待推理区域的图像特征,最后,使用基于残差去冗余特征的特征融合模块以保证在融合中间特征图的过程中减少无效特征信息对图像修复的干扰.在人脸、街景等数据集上端对端地对所提模型进行实验的结果表明,与经典方法相比,该模型在峰值信噪比、结构相似度和平均L1损失评估指标方面分别提升了3%,1%和3%.

     

    Abstract: Existing image inpainting methods based on deep learning have the problem of insufficient utilization of multi-scale feature space information in undamaged areas of images. For this problem, we proposed an image inpainting model based on pyramid spatial attention and feature reasoning. Firstly, the region identification module based on partial convolution is used to identify the region that needs reasoning in this cycle. Secondly, the circular feature inference module is used to efficiently reason the image features of the area to be reasoned. Finally, the feature fusion module based on residual redundancy feature is used to ensure that the interference of invalid feature information on image inpainting is reduced in the process of fusing intermediate feature maps. We experiment with our model end-to-end on the face, street view, and other datasets, and the results show that compared with the classical methods, the peak signal-to-noise ratio,structural similarity, and average L1 loss evaluation index of this model are improved by 3%, 1%, and 3%,respectively.

     

/

返回文章
返回