高级检索
王欣, 王琦琦, 杨国威, 郭肖勇. 注意力机制和特征融合的自动抠图算法[J]. 计算机辅助设计与图形学学报, 2020, 32(9): 1473-1483. DOI: 10.3724/SP.J.1089.2020.18121
引用本文: 王欣, 王琦琦, 杨国威, 郭肖勇. 注意力机制和特征融合的自动抠图算法[J]. 计算机辅助设计与图形学学报, 2020, 32(9): 1473-1483. DOI: 10.3724/SP.J.1089.2020.18121
Wang Xin, Wang Qiqi, Yang Guowei, Guo Xiaoyong. Automatic Image Matting with Attention Mechanism and Feature Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(9): 1473-1483. DOI: 10.3724/SP.J.1089.2020.18121
Citation: Wang Xin, Wang Qiqi, Yang Guowei, Guo Xiaoyong. Automatic Image Matting with Attention Mechanism and Feature Fusion[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(9): 1473-1483. DOI: 10.3724/SP.J.1089.2020.18121

注意力机制和特征融合的自动抠图算法

Automatic Image Matting with Attention Mechanism and Feature Fusion

  • 摘要: 针对目前人工抠图工作量大,而自动抠图无法区分多个实例的问题,提出了一种注意力机制和特征融合的自动抠图算法.该算法由预分割模块和Alpha抠图模块2部分组成,分别采用了不同的网络结构.其中预分割模块是使用迁移学习方法对Mask Scoring R-CNN进行微调实现了对多实例自然图像的实例分割,从而得到输入图像前景个体的二值化分割图.而Alpha抠图模块在此基础上首先对二值化分割图预处理生成三分图,然后将三分图与原输入图像一起输入Alpha抠图模块网络.通过为Alpha抠图模块设计不同的解码策略和注意力机制,实现了对图像细节信息的精确恢复.在后续对自制车辆数据集的无人工交互前景车辆Alpha估计对比实验中,相比现有DIM算法,该算法的SAD降低19.2%,MSE降低26.3%,达到了更高的抠图精度.

     

    Abstract: In response to the current problem of the excessive workload of manual matting and the inability of automatic matting to distinguish between multiple instances,an automatic matting algorithm with attention mechanism and feature fusion is proposed.The algorithm consists of two parts,the pre-segmentation module and the Alpha matting module,which adopt different structures respectively.The presegmentation module uses transfer learning method to fine-tune a mask scoring R-CNN to implement instance segmentation of multi-instance natural images and obtain a binary segmentation of the foreground individuals.Based on this,the Alpha module first pre-processes the binary segmentation map into a generate trimap,which is then fed into the Alpha matting module network along with the original input image.By designing different decoding strategies and attention mechanisms for the Alpha matting module,the accurate recovery of input image details is achieved.In a follow-up comparison experiment of foreground vehicle Alpha estimation,which uses a homemade vehicle data set but without human interaction,this algorithm achieves a higher matting accuracy with 19.2%lower SAD and 26.3%lower MSE than the existing DIM algorithm.

     

/

返回文章
返回