高级检索
丁赛赛, 吕佳. 采用pix2pixHD的高分辨率皮肤镜图像合成方法[J]. 计算机辅助设计与图形学学报, 2020, 32(11): 1795-1803. DOI: 10.3724/SP.J.1089.2020.18199
引用本文: 丁赛赛, 吕佳. 采用pix2pixHD的高分辨率皮肤镜图像合成方法[J]. 计算机辅助设计与图形学学报, 2020, 32(11): 1795-1803. DOI: 10.3724/SP.J.1089.2020.18199
Ding Saisai, Lyu Jia. High Resolution Dermoscopy Image Synthesis Method with pix2pixHD[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(11): 1795-1803. DOI: 10.3724/SP.J.1089.2020.18199
Citation: Ding Saisai, Lyu Jia. High Resolution Dermoscopy Image Synthesis Method with pix2pixHD[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(11): 1795-1803. DOI: 10.3724/SP.J.1089.2020.18199

采用pix2pixHD的高分辨率皮肤镜图像合成方法

High Resolution Dermoscopy Image Synthesis Method with pix2pixHD

  • 摘要: 皮肤镜图像中的皮肤病变自动识别是提高诊断性能和减少皮肤癌死亡的重要方法.针对训练数据不足的问题,提出一种基于pix2pixHD的高分辨率皮肤镜图像合成方法.首先,通过皮肤病灶的真实边界,结合病变类别对皮肤病变知识进行建模,获取包含病理意义的标签映射;其次,以标签映射作为病变合成的约束条件,利用构建的生成对抗网络模型实现标签映射向皮肤镜图像的空间映射,同时将生成器的浅层和深层特征相结合以避免图像细节信息的丢失;然后,引入标准差特征匹配损失以稳定生成对抗网络的训练.在ISIC-2017数据集上的实验结果表明,相比不同合成方法生成图像的质量,该方法具有更好的视觉效果以及IS与FID定量化指标评价,并且可为监督学习网络提供额外的信息增益,以提高皮肤病变分类的准确度.

     

    Abstract: Automated skin lesion recognition in dermoscopy images is an essential way to improve the diagnostic performance and reduce skin cancer deaths.To solve the problem of insufficient training data,a high resolution dermoscopy image synthesis method with pix2pixHD is proposed in this paper.First,a label mapping with pathological significance is obtained to model the knowledge of skin lesions by combining the ground truth of skin lesions with the lesion category.Second,the label mapping is used as the constraint condition for lesion synthesis,and the constructed generator adversarial network is used to implement the spatial mapping of the label mapping.In order to avoid the loss of image details,the shallow and deep features together at each scale of the generator are combined.After that,the standard deviation matching loss is introduced to stabilize the training of generator adversarial network.Compared with the quality of images generated by different synthesis methods,the experimental results on the ISIC-2017 dataset show that this method has better visual effect and quantitative index evaluation of IS and FID,and can provide additional information gain for the supervised learning network to improve the accuracy of skin lesion classification.

     

/

返回文章
返回