高级检索

融合时空约束的光学动作捕捉标记点实时补全方法

A Spatio-Temporal Constraints Based Real-Time Optical Motion Capture Missing Marker Recovery Method

  • 摘要: 在基于标记点的光学动作捕捉系统中,针对粘贴在用户身上的标记点受遮挡等因素影响丢失跟踪位置后导致人体位姿计算失败的问题,提出一种基于深度学习的标记点序列预测补全方法.该方法中,深度学习网络模型以人体运动的时间反演对称性作为理论依据,使用双向长短期记忆网络作为网络主体架构;在模型训练过程中提出组合损失函数,分别对人体关键运动节点的活动范围、同一段骨骼上标记点之间的刚性结构,以及标记点运动轨迹的时间连续性进行限制,确保补全的标记点序列符合人体运动的时空约束.在HDM05数据集上的实验结果表明,与现有方法相比,在丢失不同数量、不同时间跨度的标记点序列的条件下,所提方法补全标记点位置的平均误差下降超过14%.

     

    Abstract: In the marker based optical motion capture system, the marker occlusion and various factors can easily lead to a failure of pose reconstruction. This paper proposes a deep learning model based on spatio-temporal constraints for real-time recovery of continuous missing marker sequences. The deep learning network model is based on the time reversal symmetry of human motion and uses the bi-directional long short-term memory network as the backbone of the network. In the process of model training, the combined loss function was proposed to limit the movement range of the key joints, the rigid structure between the markers on the same bone and the time continuity of the markers’ movement track, so as to ensure that the recovered marker sequence conforms to the spatio-temporal constraints of human movement. The experimental results on the HDM05 dataset show that the average error of the proposed method is reduced by more than 14% when compared with the existing method, under the condition that different number of marker sequences and different time spans are missing.

     

/

返回文章
返回