高级检索
张惠嵌, 李桂清, 柳雨新, 聂勇伟, 冼楚华. 单幅图像人手参数模型深度网络回归方法[J]. 计算机辅助设计与图形学学报, 2022, 34(11): 1684-1692. DOI: 10.3724/SP.J.1089.2022.19171
引用本文: 张惠嵌, 李桂清, 柳雨新, 聂勇伟, 冼楚华. 单幅图像人手参数模型深度网络回归方法[J]. 计算机辅助设计与图形学学报, 2022, 34(11): 1684-1692. DOI: 10.3724/SP.J.1089.2022.19171
Zhang Huiqian, Li Guiqing, Liu Yuxin, Nie Yongwei, Xian Chuhua. Deep Neural Network Regression of MANO from a Single Image[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(11): 1684-1692. DOI: 10.3724/SP.J.1089.2022.19171
Citation: Zhang Huiqian, Li Guiqing, Liu Yuxin, Nie Yongwei, Xian Chuhua. Deep Neural Network Regression of MANO from a Single Image[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(11): 1684-1692. DOI: 10.3724/SP.J.1089.2022.19171

单幅图像人手参数模型深度网络回归方法

Deep Neural Network Regression of MANO from a Single Image

  • 摘要: 为了提高从单目RGB图像估计人手的姿态与形状的精确性和准确性,加速3D重建过程,同时结合深度网络的高效性和迭代拟合的稳定性,提出单目图像人手网格重建方法.首先利用卷积神经网络模型从图像提取稀疏特征;然后根据稀疏特征回归人手模型参数,回归参数用于初始化迭代优化例程,将人手模型拟合到3D关节点上;最后用迭代拟合的人手参数逆向监督整个网络.基于弱透视投影模型,采用大型手势动作数据库FreiHand和ObMan进行实验的结果表明,所提方法在姿态误差和网格误差上较对比方法分别降低约52%和59%,在运行效率上较对比方法快约3倍.

     

    Abstract: In order to improve the precision and efficiency of estimating the pose and shape of the 3D human hand from a monocular RGB image and accelerate 3D reconstruction, combining the efficiency of deep neural networks and accuracy of traditional optimization, DeepMANO is proposed. First, a DNN model is used to extract sparse features from image, then using these features to regress MANO model parameters. The regressed parameters are then used to initialize the iterative optimization routine which fits MANO to 3D joints. Finally, the parameters obtained by the routine are employed to supervise the network. Two large hand motion datasets, FreiHand and ObMan, are utilized to train the network. The approach assumes a weak perspective model. Experimental results show that the hand pose error is reduced by 52% and mesh error is reduced by 59% compared with state-of-the-art (SOTA) methods. The running time is about three times faster than SOTA methods.

     

/

返回文章
返回