高级检索
王聪, 陈莹. 基于全尺度特征融合的自监督单目深度估计[J]. 计算机辅助设计与图形学学报, 2023, 35(5): 667-675. DOI: 10.3724/SP.J.1089.2023.19418
引用本文: 王聪, 陈莹. 基于全尺度特征融合的自监督单目深度估计[J]. 计算机辅助设计与图形学学报, 2023, 35(5): 667-675. DOI: 10.3724/SP.J.1089.2023.19418
Wang Cong, Chen Ying. Self-Supervised Monocular Depth Estimation Based on Full Scale Feature Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(5): 667-675. DOI: 10.3724/SP.J.1089.2023.19418
Citation: Wang Cong, Chen Ying. Self-Supervised Monocular Depth Estimation Based on Full Scale Feature Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2023, 35(5): 667-675. DOI: 10.3724/SP.J.1089.2023.19418

基于全尺度特征融合的自监督单目深度估计

Self-Supervised Monocular Depth Estimation Based on Full Scale Feature Fusion

  • 摘要: 针对自监督单目深度估计生成的深度图边界模糊、伪影过多等问题,提出基于全尺度特征融合模块(FSFFM)和链式残差池化模块(CRPM)的深度网络编解码结构.在解码时,将编码器得到的高分辨率和相同分辨率特征与之前解码器得到的低分辨率特征以及上一级逆深度图进行融合,使网络学习到的特征既包含全局信息又包含局部信息.使用CRPM从融合特征中获取背景上下文信息,最终得到更精确的深度图.在KITTI数据集上进行了实验,与之前工作相比,该方法深度值绝对误差降低了7.8%,阈值为1.25的精确度提高了1.1%,其结果优于现有大多数自监督单目深度估计算法.

     

    Abstract: In order to solve the problems of fuzzy boundary and artifacts in the depth map generated by self-supervised monocular depth estimation, a depth network coding and decoding structure based on full scale feature fusion module (FSFFM) and chain residual pooling module (CRPM) is proposed. For decoding in FSFFM, the higher resolution features, the same resolution features obtained by the encoder and the lower resolution features obtained by the previous decoder are fused with the upper level inverse depth map, which enables the features learned by the network contain both global and local information. Then CRPM is designed and used to get the background context information from the fusion features. Finally, an accurate depth map is obtained. Experiments are carried out on KITTI dataset. Compared with baseline, the absolute error of depth value is reduced by 7.8%, and the accuracy with a threshold of 1.25 is improved by 1.1%. The results are better than most existing self supervised monocular depth estimation algorithms.

     

/

返回文章
返回