高级检索

选择性状态空间双序列特征强化编解码三维点云形状补全方法

Selective-state-spacebasedDual-sequenceFeature-EnhancedCodingand Decoding Method For 3D Point Cloud Shape Completion

  • 摘要: 针对由于输入点云数据的不完整、无规则和离散化, 现有的补全方法难以从残缺点云数据中提取足够全局信息以生成准确的完整形状的问题, 提出基于选择性状态空间的双序列特征强化编解码方法, 用于三维残缺点云形状的修复和补全. 首先利用Hilbert填充曲线获得残缺点云对象的2组不同序列并提取其双序列特征, 融合后, 经多层次选择性状态空间的压缩和隐藏状态整合得到残缺点云双序列特征的强化编码; 然后对点云编码进行逐点分割以捕获现有形状和缺失结构, 生成能表示三维骨架轮廓的低密度点云特征. 再利用点云全局注意力特征去除偏离整体形状的离群点, 利用分组局部特征去除偏离局部结构的噪点; 最后通过键特征和查询特征构造多阶段的点云上采样解码器, 获得完整的高密度三维点云补全形状. 在3个数据集上, 与11种主流的点云补全方法的实验结果表明, 与基准网络相比, 所提方法的评价指标CD-1, CD-2和EMD分别降低1%~10%, 1%~22%, 3%~23%, F1增加了8%~11%, 验证了该方法的有效性.

     

    Abstract: Due to the incomplete, irregular and discrete nature of the input point cloud data, it is difficult for the existing complementation methods to extract enough global information from the defective point cloud data to generate accurate and complete shapes. In this paper, a dual-sequence feature-enhanced coding and decoding method based on selective state space is proposed for repairing and completing 3D defective point cloud shapes. Firstly, two different sequences of the defective point cloud objects are obtained by using Hilbert filling curves and their dual-sequence features are extracted, which are fused together and integrated with the compression and hidden states of the multi-level selective state space to obtain the enhanced coding of the dual-sequence features of the defective point cloud; secondly, the point-by-point segmentation of the point cloud coding is carried out to capture the existing shapes and the missing structures, and then the low-density point cloud features that can represent the contours of the three-dimensional skeleton are generated. Next, the point cloud encoding is segmented point by point to capture existing shapes and missing structures, and generate low-density point cloud features that can represent the 3D skeleton contours. In the meantime, the point cloud global attention features are used to remove outliers that deviate from the overall shape, and the grouped local features are used to remove noisy points that deviate from the local structures; next, the key features and query features are used to construct a multi-stage point cloud up-sampling decoder, and a complete high-density 3D point cloud is obtained with the supplemented shapes. Experimental results on three datasets with 11 mainstream point cloud complementation methods show that the evaluation metrics CD-1, CD-2 and EMD of the proposed method decrease by 1%-10%, 1%-22%, 3%-23%, and increase by 8%-11%, respectively, compared with the baseline network, which verifies the validity of the method.

     

/

返回文章
返回