高级检索
李佳林, 沈哲. 空间域增强的通道自适应深度伪造图像检测方法[J]. 计算机辅助设计与图形学学报. DOI: 10.3724/SP.J.1089.2023-00113
引用本文: 李佳林, 沈哲. 空间域增强的通道自适应深度伪造图像检测方法[J]. 计算机辅助设计与图形学学报. DOI: 10.3724/SP.J.1089.2023-00113
Jialin LI, Zhe SHEN. Spatial Domain Enhanced Channel Adaptive Deepfake Image Detection Method[J]. Journal of Computer-Aided Design & Computer Graphics. DOI: 10.3724/SP.J.1089.2023-00113
Citation: Jialin LI, Zhe SHEN. Spatial Domain Enhanced Channel Adaptive Deepfake Image Detection Method[J]. Journal of Computer-Aided Design & Computer Graphics. DOI: 10.3724/SP.J.1089.2023-00113

空间域增强的通道自适应深度伪造图像检测方法

Spatial Domain Enhanced Channel Adaptive Deepfake Image Detection Method

  • 摘要: 针对现有的深度伪造检测方法缺少关注图像空间域信息及模型复杂度较高的问题, 提出一种使用空间域噪声增强的通道自适应深度伪造图像检测方法. 首先提取图像空间域信息并归一化空域特征图, 将空域信息作为第四个通道传入网络; 其次, 在主干网络中加入SE-Layer模块, 对四个通道的权重进行重建, 解决通道间的异构性问题; 最后, 设计了半自动的预训练策略, 进一步提升了模型训练效率和准确率. 以深度伪造人脸检测为例, 在7个不同来源的数据集上进行检测实验. 结果表明, 与基线方法对比, 在未使用数据增强技术的情况下, 文中方法仍然取得了更高的准确率.

     

    Abstract: Aiming at the problems that the current deepfake detection method lacks attention to the spatial domain information of the image and the high complexity of the model, a channel adaptive depth forgery detection method using spatial domain enhancement is proposed. Firstly, spatial domain features of the images are extracted and normalized, which will be passed into the network as the fourth channel; secondly, SE-Layer module is incorporated into the backbone network to reconstruct the weights of the four channels, effectively addressing the heterogeneity issue between channels; finally, a semi-automatic pre-training strategy is designed to further improve the training efficiency and accuracy of the model. Taking deepfake face detection as an example, the detection experiment is conducted on seven datasets from different sources. The results show that the method achieves higher accuracy compared with the baseline method although no data augumentation technique is used.

     

/

返回文章
返回