高级检索
沈伟超, 马天朔, 武玉伟, 贾云得. 组件感知的高分辨率三维物体重建方法[J]. 计算机辅助设计与图形学学报, 2021, 33(12): 1887-1898. DOI: 10.3724/SP.J.1089.2021.18805
引用本文: 沈伟超, 马天朔, 武玉伟, 贾云得. 组件感知的高分辨率三维物体重建方法[J]. 计算机辅助设计与图形学学报, 2021, 33(12): 1887-1898. DOI: 10.3724/SP.J.1089.2021.18805
Shen Weichao, Ma Tianshuo, Wu Yuwei, Jia Yunde. Component-Aware High-Resolution 3D Object Reconstruction[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(12): 1887-1898. DOI: 10.3724/SP.J.1089.2021.18805
Citation: Shen Weichao, Ma Tianshuo, Wu Yuwei, Jia Yunde. Component-Aware High-Resolution 3D Object Reconstruction[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(12): 1887-1898. DOI: 10.3724/SP.J.1089.2021.18805

组件感知的高分辨率三维物体重建方法

Component-Aware High-Resolution 3D Object Reconstruction

  • 摘要: 基于体素表示的三维物体重建计算代价会随着体素分辨率的增加呈立方增长.为了缓解这一问题,提出组件感知的三维物体重建方法,将三维物体分解成多个组件,通过预测组件几何结构和组装组件的方式重建三维物体,从而将高分辨率三维物体的重建问题分解成一系列低分辨率组件的重建问题.组件感知的三维物体重建方法使用组件位置预测模块预测所有组件的位置;使用组件特征提取模块融合组件表观特征与组件几何特征生成组件联合特征;使用组件几何结构重建模块根据组件联合特征重建组件的几何形状;最后将所有组件按其位置信息组装成高分辨率的三维物体.实验使用ShapeNet数据集在一个拥有12 GB内存的NVIDIA 1080 Maxwell GPU上进行.对比方法包括一个基于八叉树的高分辨率重建方法、一个基于LSTM的低分辨率重建方法和一个使用编码器-解码器架构的Baseline方法.高分辨率重建结果显示,组件感知的三维物体重建方法能够以较小的计算代价取得满意的高分辨率三维物体重建精度.在低分辨率重建实验上,该方法也取得了更高的重建精度,在13个类别上的平均精度达到了0.618.

     

    Abstract: The computational cost of the voxel-based 3D object reconstruction grows cubically with the in-crease of the resolution.To address this problem,the proposed component-aware 3D object reconstruction method decomposes a 3D object into several components to reconstruct the 3D object by predicting and as-sembling a series of components,which transforms the high-resolution 3D object reconstruction into a series of low-resolution component reconstruction.The proposed method predicts the positions of all components using a component position prediction module.Then the geometric and appearance feature of a component are fused into a joint feature with a component feature extraction module.The joint feature is utilized by a component shape reconstruction module to predict the geometry of components.Finally,all components are assembled into a high-resolution 3D object with the guidance of their positions.Experiments are performed on ShapeNet dataset using an NVIDIA 1080 Maxwell GPU with 12GB of memory.The comparison methods include an octree-based high-resolution reconstruction method,a LSTM-based low-resolution reconstruction method and a baseline method using encoder-decoder architecture.The results of high-resolution recon-struction experiment demonstrate that the component-aware 3D reconstruction method achieves a satisfac-tory 3D reconstruction accuracy with a low computational cost.In the low-resolution reconstruction experiment,the proposed method also performs better and the average accuracy in 13 categories reaches 0.618.

     

/

返回文章
返回