高级检索
梁嘉炜, 邱桃荣, 周爱云, 徐盼, 谢学梅, 付豪. 集成多尺度微调卷积神经网络下的甲状腺结节良恶性识别[J]. 计算机辅助设计与图形学学报, 2021, 33(1): 81-91. DOI: 10.3724/SP.J.1089.2021.18254
引用本文: 梁嘉炜, 邱桃荣, 周爱云, 徐盼, 谢学梅, 付豪. 集成多尺度微调卷积神经网络下的甲状腺结节良恶性识别[J]. 计算机辅助设计与图形学学报, 2021, 33(1): 81-91. DOI: 10.3724/SP.J.1089.2021.18254
Liang Jiawei, Qiu Taorong, Zhou Aiyun, Xu Pan, Xie Xuemei, Fu Hao. Ensemble of Multiscale Fine-Tuning Convolutional Neural Networks for Recognition of Benign and Malignant Thyroid Nodules[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(1): 81-91. DOI: 10.3724/SP.J.1089.2021.18254
Citation: Liang Jiawei, Qiu Taorong, Zhou Aiyun, Xu Pan, Xie Xuemei, Fu Hao. Ensemble of Multiscale Fine-Tuning Convolutional Neural Networks for Recognition of Benign and Malignant Thyroid Nodules[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(1): 81-91. DOI: 10.3724/SP.J.1089.2021.18254

集成多尺度微调卷积神经网络下的甲状腺结节良恶性识别

Ensemble of Multiscale Fine-Tuning Convolutional Neural Networks for Recognition of Benign and Malignant Thyroid Nodules

  • 摘要: 针对由于训练图像样本较少与忽略多尺度的结构和纹理信息而导致分类性能不佳问题,为提升甲状腺结节良恶性诊断准确率,提出了集成多尺度微调卷积神经网络下的甲状腺结节超声图像识别算法.首先将图像转换成具有3种不同尺度信息作为输入数据,以便模型能够学习到图像不同尺度的特征信息,提高模型的特征提取能力;其次,通过优化3种预训练模型(AlexNet,VGG16和ResNet50)的全连接层结构和迁移学习与微调策略,构建了3种不同尺度的9个微调模型,让模型能够更好地学习源域(ImageNet)和目标域(甲状腺超声图像)上的特征差异;最后选择最优的微调模型组合并通过对模型输出类别概率的加权融合方法得到最终的集成模型,利用模型的多样性进一步提升分类性能.文中算法在真实采集的数据集上和其他算法进行对比实验,得到甲状腺结节良恶性识别的准确率为96.00%,敏感度为94.10%,特异度为97.70%,AUC为98.00%实验结果表明,该算法在这些指标上均优于传统机器学习算法和当前甲状腺结节良恶性识别领域中的其他算法,能够有效地提取出互补的视觉特征信息,具有令人满意的分类性能.

     

    Abstract: Aiming at the problem of poor classification performance due to the small number of training image samples and ignoring multiscale structure and texture information,in order to improve the accuracy of diagnosis of benign and malignant thyroid nodule,this paper proposes a method for thyroid nodule ultrasound image recognition based on ensemble of multiscale fine-tuning convolutional neural networks.Firstly,the image is converted into three different scales of information as input data,so that the model can learn the feature information of different scales of the image,and improve the feature extraction ability of the model.Secondly,nine fine-tuning models of three different scales were constructed by optimizing the full-connection layer structure of three kinds of pretraining models(AlexNet,VGG16 and ResNet50)and the transfer learning and fine-tuning strategy,so that the model could better learn the characteristic differences of source domain(ImageNet)and target domain(thyroid ultrasound image).Finally,the optimal fine-tuning model combination is selected and the final integration model is obtained by the weighted fusion method of model output category probability,and the classification performance is further improved by utilizing the diversity of models.The proposed algorithm was compared with other algorithms on the real data set,and the accuracy,sensitivity,specificity and area under curve(AUC)of benign and malignant thyroid nodules were 96.0%,94.1%,97.7%and 0.98.The experimental results show that the algorithm is superior to the traditional machine learning algorithm and other algorithms in the field of benign and malignant thyroid nodule identification,and can effectively extract complementary visual feature information with satisfactory classification performance.

     

/

返回文章
返回