高级检索
李明, 李晋芳, 何汉武, 蔡嘉鸿. 面向虚拟试戴系统的人脸位姿估计方法[J]. 计算机辅助设计与图形学学报, 2020, 32(12): 1985-1993. DOI: 10.3724/SP.J.1089.2020.18225
引用本文: 李明, 李晋芳, 何汉武, 蔡嘉鸿. 面向虚拟试戴系统的人脸位姿估计方法[J]. 计算机辅助设计与图形学学报, 2020, 32(12): 1985-1993. DOI: 10.3724/SP.J.1089.2020.18225
Li Ming, Li Jinfang, He Hanwu, Cai Jiahong. A Face Pose Estimation Method for Virtual Try-On System[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(12): 1985-1993. DOI: 10.3724/SP.J.1089.2020.18225
Citation: Li Ming, Li Jinfang, He Hanwu, Cai Jiahong. A Face Pose Estimation Method for Virtual Try-On System[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(12): 1985-1993. DOI: 10.3724/SP.J.1089.2020.18225

面向虚拟试戴系统的人脸位姿估计方法

A Face Pose Estimation Method for Virtual Try-On System

  • 摘要: 在虚拟试戴系统中,虚拟物体需要精准地叠加至实时的人脸图像上,这决定了虚拟试戴系统的体验感,其中的关键技术在于快速准确地估计人脸的实时三维空间位姿.针对这一技术要求,提出一种实时估计人脸位姿的方法,并构建了虚拟试戴原型系统.首先使用深度相机采集人脸数据,分析单帧正面图像的彩色和深度信息,计算人脸特征点三维数据;然后结合从视频帧中提取的实时人脸特征点二维数据,使用直接线性变换法求解出人脸的实时位姿.基于消费级深度相机Astra Mini S和Unity3D引擎开发了原型系统,并进行了虚拟试戴实验;使用Biwi数据集检验位姿估计方法的精确度,并且在不同光照和部分人脸遮挡的条件下测试方法的鲁棒性.实验结果表明,文中人脸位姿估计方法的实时性、精确度和鲁棒性均能满足虚拟试戴系统的体验感.

     

    Abstract: In the virtual try-on system,virtual objects need to be superimposed on the real-time face image accurately,which determines the experience of the virtual try-on system.The key technology is to estimate the real-time 3D face pose quickly and accurately.In response to this technical requirement,a method for real-time estimation of the face pose was proposed,and a virtual try-on prototype system was constructed.The method first used a depth camera to collect face data,analyzed the color and depth information of a single frontal image,and calculated the 3D face feature points;then combined the 2D real-time face feature points extracted from video frames,and used the direct linear transformation method to solve the real-time face pose.Based on the consumer-level depth camera Astra Mini and Unity3D engine,a prototype system was developed and a virtual try-on experiment was conducted;the accuracy of the pose estimation method was tested using the Biwi data set,and the robustness was tested under different lighting and partial face occlusion conditions.The results show that:the real-time performance,accuracy and robustness of the pose estimation method in this paper can satisfy the experience of the virtual try-on system.

     

/

返回文章
返回