高级检索

基于动态图卷积和PointNet的三维局部特征描述符

Three-Dimensional Local Feature Descriptor based on Dynamic Graph Convolution and PointNet

  • 摘要: 提取高描述性和强鲁棒性的点云局部特征描述符是点云配准中的关键环节.针对现有基于学习的描述符方法依赖于对噪声敏感的手工特征或不具有旋转不变性等问题,提出一种基于动态图卷积和PointNet的三维局部特征描述符生成网络,以提取具有旋转不变性和强泛化性的局部特征描述符.首先,将与局部参考框架对齐后的局部点云作为网络的输入,分别通过动态图卷积模型和PointNet模型提取输入点云中的局部几何特征和点特征,解决单一PointNet模型无法学习输入点集中点与点之间关系的问题;然后,为进一步提高网络的学习能力,提出一个由点自注意力模块和局部空间注意力模块组成的双重注意力机制层,用于更好地融合2个模型提取到的特征,来获取最终的描述符特征.在室内数据集3DMatch和室外数据集ETH和KITTI上的大量实验表明:所提网络在3DMatch上的特征匹配召回率达到98.2%,在ETH和KITTI上的特征匹配召回率和正确率分别达到98.7%和99.82%,验证了方法的有效性.

     

    Abstract: Extracting a local feature descriptor of point cloud with high description and strong robustness is a key step in point cloud registration. For the problems of existing learning-based descriptors not having rotation invariance or relying on hand-crafted features that are sensitive to noise, a 3D local feature descriptor generation network based on dynamic graph convolution and PointNet is proposed to extract local feature descriptors with rotation invariance and strong generalization. Firstly, the local patch aligned with the local reference frame is used as the input to the network, and the local geometric features and point features are extracted by the dynamic graph convolution model and the PointNet model, respectively, to solve the problem that a single PointNet model is unable to learn the relationship between points in the input point set. Then, to further improve the learning ability of the network, a dual attention mechanism layer, containing a point self-attention module and a local spatial-attention module, is proposed to better integrate the features extracted by the two models to obtain the final descriptor features. Extensive experiments on the indoor dataset 3DMatch and the outdoor datasets ETH and KITTI show that the proposed network achieves a feature matching recall of 98.2% on 3DMatch, and a feature matching recall and success rate of 98.7% and 99.82% on ETH and KITTI, respectively, verifying the effectiveness of the proposed method.

     

/

返回文章
返回