高级检索
包永堂, 周鹏飞, 齐越. 面向单幅图像的逼真3D人脸重建方法[J]. 计算机辅助设计与图形学学报, 2022, 34(12): 1850-1858. DOI: 10.3724/SP.J.1089.2022.19485
引用本文: 包永堂, 周鹏飞, 齐越. 面向单幅图像的逼真3D人脸重建方法[J]. 计算机辅助设计与图形学学报, 2022, 34(12): 1850-1858. DOI: 10.3724/SP.J.1089.2022.19485
BAO Yong-tang, ZHOU Peng-fei, QI Yue. Realistic 3D Face Reconstruction Method for Single Image[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(12): 1850-1858. DOI: 10.3724/SP.J.1089.2022.19485
Citation: BAO Yong-tang, ZHOU Peng-fei, QI Yue. Realistic 3D Face Reconstruction Method for Single Image[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(12): 1850-1858. DOI: 10.3724/SP.J.1089.2022.19485

面向单幅图像的逼真3D人脸重建方法

Realistic 3D Face Reconstruction Method for Single Image

  • 摘要: 针对3DMM参数拟合方法生成的纹理过于粗糙、结果不够逼真的问题,提出一种基于深度学习的单幅图像逼真3D人脸重建方法.首先构建RP-Net回归网络和包含5万幅人脸图像的数据集,从输入图像中学习参数,并拟合人脸模型生成3D人脸几何;然后通过构造多层次的损失函数进行弱监督学习,包括低水平的像素损失、地标损失和高水平的身份损失;最后通过纹理映射的方式生成逼真的人脸纹理.在2个通用人脸数据集和1个人工生成的人脸数据集上与最近的3D人脸重建方法进行对比实验,并对影响重建的光照、表情和转向等因素进行实验,根据SSIM和PSNR对3D重建结果进行量化分析.实验结果表明,所提方法面向单幅图像可以生成准确的3D人脸形状和逼真的人脸纹理;与最近的3D人脸重建方法相比,该方法的训练时间和迭代次数分别降低了6%和13%,SSIM值增加0.005~0.010, PSNR值平均提高0.03~0.08 dB.

     

    Abstract: To solve the problem that the 3DMM parameter fitting methods cannot generate realistic 3D face,a single-image realistic 3D face reconstruction method based on deep learning is proposed. Firstly, the RP-Net regression network is constructed, and a dataset containing 50 000 face images is constructed at the same time. The parameters are learned from the input images, and the face model is fitted to generate the 3D face geometry. Secondly, weakly supervised learning is performed by constructing a multi-level loss function, which includes low-level pixel loss, landmark loss, and high-level identity loss. Thirdly, a realistic face texture is generated by means of texture mapping. Finally, two real face data and one generated data are used to compare experiments with recent 3D face reconstruction methods. The factors affecting the reconstruction such as lighting, expression, and steering are used to test proposed method, and quantitatively evaluate the reconstruction by SSIM and PSNR. These results show that proposed method can generate accurate face shapes and realistic face textures. Compared with the recent 3D face reconstruction method, the training time and number of iterations of the proposed method are reduced by 6% and 13%, respectively, the SSIM value is increased by 0.005-0.010, and the PSNR value is increased by 0.03-0.08 dB on average.

     

/

返回文章
返回