高级检索

基于自适应特征融合的无纹理3D目标跟踪

Textureless 3D Object Tracking Based on Adaptive Feature Fusion

  • 摘要: 基于轮廓匹配的无纹理3D目标跟踪算法需要根据3D模型和2D投影轮廓的3D—2D匹配点连续估计目标的位置和姿态,但在背景复杂和运动模糊的情况下容易错配导致跟踪失败.针对此问题,提出一种基于自适应特征融合的3D目标跟踪算法.首先在3D模型投影轮廓附近进行轮廓匹配和颜色统计建模,以提取轮廓特征和颜色特征;然后定义基于轮廓特征和颜色特征自适应加权的能量函数,并计算其相对于位置和姿态参数的偏导数;最后通过LM优化算法求解位置和姿态参数的最优值.为处理目标和相机的快速运动,采用由粗到细的策略在多尺度视频帧中迭代跟踪.定性和定量实验结果表明,在复杂背景和运动模糊的情况下,该算法仍能实现快速稳定的跟踪,具有较高的精确性和鲁棒性.

     

    Abstract: Contour matching based textureless 3D object tracking method commonly use 3D-2D correspondence between the 3D object model and 2D object contour in the image to track the 3D object.However,this often fails in highly cluttered backgrounds or in presence of motion blur.To overcome this problem,we propose an 3D object tracking method based on adaptive feature fusion.Firstly,contour matching and local color statistics is performed nearby the projected contour of 3D model to extract contour feature and color feature.Then the energy function is defined based on adaptively weighted contour feature and statistical color feature,and the differentials of this energy function with respect to pose parameters of the 3D object are derived.Finally,the optimal pose is obtained via LM solver.To deal with fast motion of object and camera,a coarse-to-fine tracking strategy is applied iteratively on multi-scale video frames.Qualitative and quantitative experiments demonstrate that the proposed method improves robustness and accuracy with respect to cluttered backgrounds and motion blur effect.

     

/

返回文章
返回