高级检索
朱威, 屈景怡, 吴仁彪. 结合批归一化的直通卷积神经网络图像分类算法[J]. 计算机辅助设计与图形学学报, 2017, 29(9): 1650-1657.
引用本文: 朱威, 屈景怡, 吴仁彪. 结合批归一化的直通卷积神经网络图像分类算法[J]. 计算机辅助设计与图形学学报, 2017, 29(9): 1650-1657.
Zhu Wei, Qu Jingyi, Wu Renbiao. Straight Convolutional Neural Networks Algorithm Based on Batch Normalization for Image Classification[J]. Journal of Computer-Aided Design & Computer Graphics, 2017, 29(9): 1650-1657.
Citation: Zhu Wei, Qu Jingyi, Wu Renbiao. Straight Convolutional Neural Networks Algorithm Based on Batch Normalization for Image Classification[J]. Journal of Computer-Aided Design & Computer Graphics, 2017, 29(9): 1650-1657.

结合批归一化的直通卷积神经网络图像分类算法

Straight Convolutional Neural Networks Algorithm Based on Batch Normalization for Image Classification

  • 摘要: 为解决深度卷积神经网络由于梯度消失而导致训练困难的问题,提出一种基于批归一化的直通卷积神经网络算法.首先对网络所有卷积层的激活值进行批归一化处理,然后利用可学习的重构参数对归一化后的数据进行还原,最后对重构参数进行训练.在CIFAR-10,CIFAR-100和MNIST这3个标准图像数据集上进行实验的结果表明,文中算法分别取得了94.53%,73.40%和99.74%的分类准确率,明显优于其他深度神经网络算法;该算法能够有效地克服传统卷积神经网络中梯度消失的问题.

     

    Abstract: In order to solve the problem that the deep convolutional neural networks are difficult to be trained due to vanishing gradients, a straight convolutional neural networks algorithm based on improving the methodology of batch normalization is proposed. Firstly, the activations of convolutional layers are normalized. Secondly, the normalized activations are restored by reconstructing parameters. Finally, the proposed algorithm is used to train reconstruction parameters. On three image datasets CIFAR-10, CIFAR-100 and MNIST, the classification accuracies of SCNN can archive 94.53%, 73.40% and 99.74% respectively, which significantly outperforms other deep neural networks algorithms. The proposed algorithm can effectively overcome the problem of vanishing gradients in traditional convolutional neural networks.

     

/

返回文章
返回