高级检索
蔡兴泉, 阮瓒茜, 孙海燕. 基于YOLOv3和MobileNetv2的银行卡号识别方法[J]. 计算机辅助设计与图形学学报, 2022, 34(1): 142-151. DOI: 10.3724/SP.J.1089.2022.18720
引用本文: 蔡兴泉, 阮瓒茜, 孙海燕. 基于YOLOv3和MobileNetv2的银行卡号识别方法[J]. 计算机辅助设计与图形学学报, 2022, 34(1): 142-151. DOI: 10.3724/SP.J.1089.2022.18720
Cai Xingquan, Ruan Zanxi, Sun Haiyan. Bank Card Number Identification Method Based on YOLOv3 and MobileNetv2[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(1): 142-151. DOI: 10.3724/SP.J.1089.2022.18720
Citation: Cai Xingquan, Ruan Zanxi, Sun Haiyan. Bank Card Number Identification Method Based on YOLOv3 and MobileNetv2[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(1): 142-151. DOI: 10.3724/SP.J.1089.2022.18720

基于YOLOv3和MobileNetv2的银行卡号识别方法

Bank Card Number Identification Method Based on YOLOv3 and MobileNetv2

  • 摘要: 针对当前银行卡号识别易受复杂背景、环境光线等因素干扰导致识别率低、不稳定的问题,提出基于YOLOv3和MobileNetv2的银行卡号识别方法.首先预处理数据集,收集多样式银行卡图片,批量进行拉普拉斯锐化及部分图像增强处理,标注图像;然后构建YOLOv3区域分割网络结构,将已标注好的数据集输入YOLOv3网络,优化目标尺寸损失和focal loss优化置信度损失,控制迭代计算,分割字码区域,输出初步识别模型,计算初步识别结果;再构建改进后的YOLOv3网络和基础MobileNetv2网络,输入预处理数据集进行训练,输出联合识别模型,计算联合识别结果;最后比对初步识别结果和联合识别结果,输出准确率最高的结果.实验时,整合扩建中软杯与和鲸科技银行卡数据集,根据字码形态分为4种类型,分别进行定位识别及准确率对比实验.结果表明,在字码区域定位效果方面,所提方法优于传统CNN和基础YOLOv3方法;在字码识别准确率方面,所提方法在4种类型银行卡上的准确率达93.74%,93.21%,95.14%和99.10%,皆优于改进的YOLOv3和YOLOv3-MobileNetv2等方法.实验证明,所提方法可以识别复杂背景下不同字码形态的银行卡字码,克服了环境因素对卡号识别的影响,提升了识别准确率,具有良好的鲁棒性,且在设计实现的验证系统和应用平台上运行稳定、可靠.

     

    Abstract: Aiming at the problem of low recognition rate and instability caused by the interference of complex backgrounds, ambient light and other factors in the current bank card number recognition, a bank card number recognition method based on YOLOv3 and MobileNetv2 is proposed. Firstly, we preprocess the datasets, collect multi-style bank card images, batch Laplace sharpening and partial image enhancement, and label the images. Afterwards we need to construct the YOLOv3 region segmentation network structure, input the marked data set into the YOLOv3 network, optimize the target size loss and focal loss, optimize the confidence loss, control the iterative calculation, segment the word code region, output the preliminary recognition model and calculate the preliminary recognition results. Then, the improved YOLOv3 network and basic MobileNetv2 network are constructed, the preprocessed data set is input for training, the joint recognition model is output, and the joint recognition results are calculated. Finally, by comparing the preliminary recognition results with the joint recognition results, the results with the highest accuracy are output. During the experiment, the data set of China Software Cup and Heywhale bank card are integrated and expanded, and divided into four types according to the word code form, and the positioning identification and accuracy comparison experiment are conducted respectively. Experimental results show that in terms of the localization effect of the code area, the proposed method is superior to the traditional CNN network and the basic YOLOv3 network. In terms of the accuracy of the code recognition, the accuracy of the method proposed on four types of bank cards is 93.74%, 93.21%, 95.14% and 99.10% respectively, all of which perform better than the improved YOLOv3 and YOLOv3-MobileNetv2 methods. Experiments prove that proposed method can recognize bank card codes with different code patterns under complex background, overcome the influence of environmental factors on card number recognition, improve recognition accuracy, and have good robustness. And it runs stably and reliably on the designed verification system and application platform.

     

/

返回文章
返回