高级检索
柏正尧, 陶劲宇. 采用伪3D卷积网络的脑部MRI图像超分辨率重建[J]. 计算机辅助设计与图形学学报, 2022, 34(2): 208-216. DOI: 10.3724/SP.J.1089.2022.18793
引用本文: 柏正尧, 陶劲宇. 采用伪3D卷积网络的脑部MRI图像超分辨率重建[J]. 计算机辅助设计与图形学学报, 2022, 34(2): 208-216. DOI: 10.3724/SP.J.1089.2022.18793
Bai Zhengyao, Tao Jinyu. Super-Resolution Reconstruction of Brain MR Images Using Pseudo-3D Convolutional Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(2): 208-216. DOI: 10.3724/SP.J.1089.2022.18793
Citation: Bai Zhengyao, Tao Jinyu. Super-Resolution Reconstruction of Brain MR Images Using Pseudo-3D Convolutional Network[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(2): 208-216. DOI: 10.3724/SP.J.1089.2022.18793

采用伪3D卷积网络的脑部MRI图像超分辨率重建

Super-Resolution Reconstruction of Brain MR Images Using Pseudo-3D Convolutional Network

  • 摘要: 针对现有深度学习医学图像超分辨率重建算法因网络参数量大导致计算复杂度过高、网络难以训练的问题,提出一种采用伪3D卷积的轻量级密集残差连接3D卷积神经网络(P3DSRNet)模型.首先利用密集残差块拓宽残差块中卷积层的通道,将更多的特征信息传送到激活函数,使网络中浅层图像特征更容易地传播到高层,增强医学图像超分辨率的表达能力;然后采用伪3D可分离卷积策略训练网络,将标准3D卷积核分离成多个卷积核,分阶段进行训练,使网络训练收敛速度更快,解决标准3D卷积拓宽维数导致网络训练难度加大时参数急剧增加的问题.实验结果表明,对比传统的插值超分辨率算法和LRTV超分辨率算法,采用P3DSRNet模型重建的医学图像纹理细节更丰富,视觉效果更逼真,与采用卷积神经网络的超分辨率算法SRCNN3D和ReCNN相比, P3DSRNet模型网络参数大大减少,峰值信噪比分别提升了1.88 dB和0.30 dB,结构相似度分别提升了0.009 6和0.001 1, P3DSRNet模型不仅大大降低了参数量和计算复杂度,而且提高了医学图像的超分辨性能.

     

    Abstract: The medical image super-resolution (SR) reconstruction algorithm based on deep learning with standard 3D convolution has too many network parameters. This leads to high computational complexity and low network training efficiency. To address these problems, a lightweight densely-connected residual 3D-CNN (P3DSRNet) combining dense residual connection with pseudo-3D convolution is proposed. Firstly, the dense residual block is used to widen the channel of the convolution layer. Hence, more feature information is transmitted to the activa-tion function, so that the low-layer image features are spread to the higher layers to improve medical image su-per-resolution. Then, the pseudo-3D separable convolution strategy is employed to train the network, where the standard 3D convolution kernel is separated into multiple convolution kernels. The network is trained stage by stage, so network training converges faster. It effectively solved the problem that the number of parameters in-crease sharply with the added network training difficulty due to the widened dimension of standard 3D convolu-tion. The experimental results show that the medical images reconstructed by the P3DSRNet model have clearer texture details and better visual effects, compared with those by the traditional interpolation and LRTV su-per-resolution algorithms. The P3DSRNet model has fewer network parameters, compared with the SRCNN3D and ReCNN super-resolution algorithms. In addition, the SR image PSNRs increase by 1.88 dB, 0.30 dB, and the SSIMs increase by 0.009 6, 0.001 1, respectively, compared with SRCNN3D and ReCNN. The P3DSRNet not only reduces the number of parameters and computational complexity, but also improves the super-resolution performances of medical images.

     

/

返回文章
返回