高级检索

多尺度分割和误差引导生成对抗网络的神经元分割方法

Multi-Scale Segmentation- and Error-Guided Generative Adversarial Network for Neuron Segmentation

  • 摘要: 神经元语义分割是实现神经元精确实例分割的关键环节. 然而, 大脑结构复杂, 全脑神经元语义分割自动化非常具有挑战性. 针对神经元类内差异大、类间差异小、在不同解剖区域分布不均匀的特征, 提出一种多尺度分割和误差引导生成对抗网络的神经元分割模型. 首先应用基于双注意力门的多尺度分割和误差引导的框架作为生成器,预测神经元分割结果、 假阴错误和假阳错误, 根据三者结果通过迭代的方式改善神经元语义分割结果; 然后将生成的分割结果、真值图分别与原始图像相乘, 作为判别器的 2 个输入, 通过多层卷积操作计算二者差异, 区分生成的分割结果和真值图. 在猕猴大脑数据集上的实验结果表明, 与 U-Net 等其他模型相比, 该模型得到的全脑神经元分割性能指标均有不同程度的提升, 尤其对于浅色神经元, 神经元分割性能得到了较大的提升, 与 8 种参考模型相比, Dice 值分别提升了 20.3%, 1.2%, 15.5%, 2.5%, 8.2%, 159.2%, 0.8%和 13.1%. 应用所提模型得到的全脑神经元的分割结果, 可以进一步用于神经元的实例分割、形态学分析等研究.

     

    Abstract: Accurate semantic segmentation is the key step to achieve accurate neuron instance segmentation. However, the complex structure of the brain makes it challenging to automatically segment neurons in the whole brain. A multiscale segmentation- and error-guided generative adversarial network is proposed to address the segmentation of neurons with large intra-class differences among neurons and small inter-class differences among neurons is small, and uneven distribution in different anatomical regions. This method applies the dual attention gate-based multiscale segmentation- and error-guided framework as the generator to predict neuron segmentation results, false negative errors and false positive errors. According to the three prediction results, the neuron semantic segmentation results are iteratively improved. Then, the generated segmentation results and the ground truth are, respectively, multiplied by the original images as the two inputs of the discriminator. The difference between the two branches is calculated by applying multiple convolutional operations to distinguish the generated segmentation results and the ground truth. The experimental results obtained on the macaque brain dataset show that compared with the reference methods such as U-Net, the performance indicators of whole brain neuron segmentation obtained by applying the proposed model have been improved, especially for light-stained neurons. Compared with eight reference models, the Dice value has increased by 20.3%, 1.2%, 15.5%, 2.5%, 8.2%, 159.2%, 0.8%, 13.1%, respectively. The proposed multiscale segmentation- and error-guided generative adversarial network can automatically and accurately segment the whole brain neurons, and can be further used for neuron instance segmentation and neuron morphological analysis.

     

/

返回文章
返回