基于半监督学习的双流多层次畸形牙颌模型语义分割方法
Semi-Supervised Learning-Based Dual-Stream Multi-Hierarchical Semantic Segmentation Method for Malocclusion Models
-
摘要: 针对基于深度学习的牙颌分割方法泛化能力欠佳, 且难以分割各种极端畸形牙颌等问题, 提出一种基于半监督学习的双流多层次畸形牙颌模型语义分割方法. 首先针对畸形牙颌在牙龈区域的大量褶皱, 改进网格谱聚类算法, 通过凝聚网格层次聚类算法生成自监督信号; 然后提取邻域特征增强牙颌关键信息, 通过多层次残差块设计局部特征处理流, 以细化牙颌局部边界, 并联结多尺度偏置注意力形成全局特征提取流, 以识别畸形牙齿语义信息; 最后融合双流特征进行牙颌分割. 实验结果表明, 在40%标注数据的前提下, 所提方法较代表性的半监督方法在准确率上提升了9.29个百分点 在计算量上降低了91.49%, 接近性能较优的全监督方法的分割精度和效率, 可更好地满足虚拟正畸系统的智能化发展需求.Abstract: Aiming at the problems of poor generalisation ability and difficulty in segmenting extreme malocclusions in deep learning-based malocclusion segmentation methods, a Semi-Supervised Learning-Based Dual-Stream Multi-Hierarchical Semantic Segmentation Method for Malocclusion Models is proposed. Firstly, for the large number of folds in the gingival region of malocclusion, the grid spectral clustering algorithm is improved to generate self-supervised signals through the cohesive grid hierarchical clustering; then, the neighbourhood features are extracted to enhance the key information of the malocclusion, and the local feature processing flow is designed through the multi-level residual blocks to refine the local boundaries of the malocclusion and the global feature extraction flow is formed through the linkage of the multi-scale bias attention to identify malocclusion semantic information; finally, the dual-stream features are fused together for the segmentation of the malocclusion. The experimental results show that with 40% of labelled data, the proposed method improves the accuracy by 9.29 percentage points compared with the representative semi-supervised method, and reduces the computational effort by 91.49%, which is close to the segmentation accuracy and efficiency of the better fully-supervised method, and it can better meet the demand for the development of the virtual orthodontic system in an intelligent way.