高级检索
毛爱华, 禚冠军, 禤骏. 采用多级拓扑图卷积网络的可变形三维着装人体重建[J]. 计算机辅助设计与图形学学报, 2022, 34(12): 1899-1910. DOI: 10.3724/SP.J.1089.2022.19225
引用本文: 毛爱华, 禚冠军, 禤骏. 采用多级拓扑图卷积网络的可变形三维着装人体重建[J]. 计算机辅助设计与图形学学报, 2022, 34(12): 1899-1910. DOI: 10.3724/SP.J.1089.2022.19225
MAO Ai-hua, ZHUO Guan-jun, XUAN Jun. Deformable 3D Clothed Humans Reconstruction by a Multi-Level Topological Graph Convolutional Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(12): 1899-1910. DOI: 10.3724/SP.J.1089.2022.19225
Citation: MAO Ai-hua, ZHUO Guan-jun, XUAN Jun. Deformable 3D Clothed Humans Reconstruction by a Multi-Level Topological Graph Convolutional Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(12): 1899-1910. DOI: 10.3724/SP.J.1089.2022.19225

采用多级拓扑图卷积网络的可变形三维着装人体重建

Deformable 3D Clothed Humans Reconstruction by a Multi-Level Topological Graph Convolutional Network

  • 摘要: 为了从单幅图像或者多幅图像中重建出可变形的着装人体,提出了一种采用蒙皮多人线性模型(skinned multi-personlinear model, SMPL)的多级拓扑构建的图卷积神经网络(multi-leveltopology graph convolutional network,MTGCN).首先,通过现有方法从图像中预计算对应姿势和体型的光滑人体SMPL模型,并通过图像特征提取网络得到人体的局部特征图;然后,将SMPL模型顶点投影到特征图中,以获取具体位置的局部特征;最后,利用MTGCN对模型顶点偏移产生着装效果,其下采样与上采样模块可融合局部特征从而获取全局特征,并结合残差模块用于弥补全局特征中丢失的局部信息,从而提升重建的人体质量.在使用MGN与SURREAL合成的图像数据集上,实验结果表明,与目前类似的工作相比,该方法能够产生更低的倒角距离误差与点到曲面的距离误差,并且在人体服装细节与人体部位等方面展示出了更好的结果.此外,生成的三维人体模型可以直接在姿势或者体型上变形,以快速生成着装人体动画.

     

    Abstract: To reconstruct a deformable clothed human from a single image or multiple images, a multi-level topological graph convolutional network(MTGCN) using SMPL is proposed. Firstly, an initial human SMPL model corresponding to the pose and shape of the human body in the image is precomputed by existing methods.Secondly, local feature map of human body is obtained by image feature extraction network. Thirdly, the vertices of SMPL model are then projected into the feature map to obtain local features of specific locations. Finally, a multi-level topological graph convolutional network is used to offset the mesh vertices for dressing effects. The down-sampling and up-sampling modules can fuse local features to obtain global features, and combine with the residual module to compensate for the missing local information on the global features, thus improving the quality of the reconstructed human body. On the synthesized dataset using MGN and SURREAL, the experimental result shows that the proposed method can produce lower chamfer distance and point-to-surface distance losses than the other similar methods, and demonstrate better results in terms of human clothing details and body parts.In addition, the reconstructed 3D human mesh can be directly deformed in pose or body shape to generate dressed human animations.

     

/

返回文章
返回