高级检索
范佩佩, 董秀成, 李滔, 任磊, 李亦宁. 基于非局部均值约束的深度图像超分辨率重建[J]. 计算机辅助设计与图形学学报, 2020, 32(10): 1671-1678. DOI: 10.3724/SP.J.1089.2020.18136
引用本文: 范佩佩, 董秀成, 李滔, 任磊, 李亦宁. 基于非局部均值约束的深度图像超分辨率重建[J]. 计算机辅助设计与图形学学报, 2020, 32(10): 1671-1678. DOI: 10.3724/SP.J.1089.2020.18136
Fan Peipei, Dong Xiucheng, Li Tao, Ren Lei, Li Yining. Super-Resolution Reconstruction of Depth Map Based on Non-Local Means Constraint[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(10): 1671-1678. DOI: 10.3724/SP.J.1089.2020.18136
Citation: Fan Peipei, Dong Xiucheng, Li Tao, Ren Lei, Li Yining. Super-Resolution Reconstruction of Depth Map Based on Non-Local Means Constraint[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(10): 1671-1678. DOI: 10.3724/SP.J.1089.2020.18136

基于非局部均值约束的深度图像超分辨率重建

Super-Resolution Reconstruction of Depth Map Based on Non-Local Means Constraint

  • 摘要: 针对现有的基于卷积神经网络的深度图像超分辨率重建算法对映射关系的学习大多局限在图像局部感知域的问题,提出一种基于非局部均值约束的深度图像超分辨率重建算法.该算法中输入的低分辨率深度图像无需上采样预处理,输入的低分辨率深度图像通过亚像素卷积神经网络训练后,由亚像素组合层实现上采样;然后利用图像的自相似性对上采样结果施加非局部均值约束,得到最终的重建结果,建立了端到端深度图像超分辨率重建网络.在Middlebury数据集上的实验结果表明,文中算法无论是主观视觉效果,还是均方根误差和结构相似性上的客观评价指标,均得到了明显的改善,优于现有RDN和EDSR算法,重建效果良好.

     

    Abstract: A super-resolution reconstruction method of depth map based on non-local means constraint is proposed to overcome the problems existing in most of the present super-resolution reconstructions,which are limited in local receptive fields with respect to the learning of mapping relationship and are based on the convolutional neural network.No up-sampling pre-processing of inputting low-resolution depth map is required in this method,and the low-resolution depth map will be up-sampled through sub-pixel assembly layer after training in the sub-pixel convolutional neural network.We make effective use of the non-local similarity of the depth map,and use a non-local means constraint on it to obtain the final reconstructed depth map,an end-to-end depth map super-resolution reconstruction network based on this is established.Experimental results on Middlebury dataset show that the algorithm in this paper achieves a marked improvement both on subjective visual effect and objective evaluation on RMSE and SSIM,compared with the existing RDN and EDSR algorithms,the reconstruction effect is superior.

     

/

返回文章
返回