高级检索
程轩, 刘仁帅, 郑英林, 曾鸣. UV空间中的人脸颜色纹理和几何细节协同补全[J]. 计算机辅助设计与图形学学报, 2022, 34(1): 113-120. DOI: 10.3724/SP.J.1089.2022.18821
引用本文: 程轩, 刘仁帅, 郑英林, 曾鸣. UV空间中的人脸颜色纹理和几何细节协同补全[J]. 计算机辅助设计与图形学学报, 2022, 34(1): 113-120. DOI: 10.3724/SP.J.1089.2022.18821
Cheng Xuan, Liu Renshuai, Zheng Yinglin, Zeng Ming. Collaborative Completion of Facial Texture and Displacement in UV Space[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(1): 113-120. DOI: 10.3724/SP.J.1089.2022.18821
Citation: Cheng Xuan, Liu Renshuai, Zheng Yinglin, Zeng Ming. Collaborative Completion of Facial Texture and Displacement in UV Space[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(1): 113-120. DOI: 10.3724/SP.J.1089.2022.18821

UV空间中的人脸颜色纹理和几何细节协同补全

Collaborative Completion of Facial Texture and Displacement in UV Space

  • 摘要: 当图像中的人脸存在较大角度的偏转时,由于自身遮挡,单幅图像3D人脸重建方法较难获取整张人脸的纹理和几何细节.考虑人脸纹理特征分布和几何细节的特征分布的双向关联特性,提出一种统一框架下的协同补全模型TDGAN.首先,将颜色纹理和几何细节映射到同一UV空间;然后,通过统一的生成对抗网络协同补全纹理与几何,并对这2部分信息分别设计全局与局部判别器,以实现纹理和几何的全局与局部一致性;最后,为了充分利用颜色纹理和几何细节共有特征,增加了一个纹理-几何一致性约束网络,从而得到高完整度和高一致性的颜色纹理与几何细节UV图.在当前最大3D人脸数据集FaceScape的实验表明,TDGAN比独立的UV空间补全方法能得到更高质量的补全结果.

     

    Abstract: When the input face has large pose, it’s hard for single view 3D face reconstruction methods to estimate complete facial texture and geometric details due to self-occlusion. Considering the correlation between the feature distributions of texture and geometric details, TDGAN is proposed, a collaborative completion model with GAN structure which could complete texture and geometric details collaboratively in a uniform framework. Firstly, the texture and geometric details are mapped into the UV space. Then, the collaborative completion is performed in a generative adversarial network which includes a generator, two global discriminators and two local discriminators. Finally, to exploit the common structures of texture and geometric details, a consistency constraint module is incorporated to the framework. The complete and consistent texture and geometric details UV maps are synthesized. Experiments on the currently largest 3D face dataset demonstrate that the proposed collaborative completion method could produce more high quality results than the independent UV completion methods.

     

/

返回文章
返回