高级检索
王宸昊, 张慧. 粗糙语义引导的同时预测前背景的透明度图估计算法[J]. 计算机辅助设计与图形学学报, 2022, 34(9): 1432-1440. DOI: 10.3724/SP.J.1089.2022.19175
引用本文: 王宸昊, 张慧. 粗糙语义引导的同时预测前背景的透明度图估计算法[J]. 计算机辅助设计与图形学学报, 2022, 34(9): 1432-1440. DOI: 10.3724/SP.J.1089.2022.19175
Wang Chenhao, Zhang Hui. Coarse Semantic Guided Alpha Matting via Simultaneous Foreground and Background Estimation[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(9): 1432-1440. DOI: 10.3724/SP.J.1089.2022.19175
Citation: Wang Chenhao, Zhang Hui. Coarse Semantic Guided Alpha Matting via Simultaneous Foreground and Background Estimation[J]. Journal of Computer-Aided Design & Computer Graphics, 2022, 34(9): 1432-1440. DOI: 10.3724/SP.J.1089.2022.19175

粗糙语义引导的同时预测前背景的透明度图估计算法

Coarse Semantic Guided Alpha Matting via Simultaneous Foreground and Background Estimation

  • 摘要: 针对抠图算法中的“溢色”现象,提出一种同时预测前景、背景和透明度图的算法,并设计了一个结合粗糙语义的自动抠图网络.该算法包括2个阶段:粗糙语义生成阶段和同时预测前背景的抠图阶段.在粗糙语义生成阶段,利用语义分割网络得到中间结果,再通过一个粗糙语义信息融合模块,在多个尺度上对语义信息进行粗略估计;在抠图阶段,利用一个编码器-解码器结构的神经网络对粗糙的语义信息进行编解码,最终得到前景、背景和透明度图的预测.上述2阶段网络可以更加准确地提取出前景物体,得到的透明度图可直接应用于影视特效、图像处理等下游任务.在Adobe数据集和Distinction-646数据集上的实验结果表明,所提算法的绝对误差和分别为42.5和50.3,梯度误差分别为27.1和28.0;抠图的细节也更为准确.

     

    Abstract: To address the“color spill”problem in image matting,an algorithm of simultaneously predicting the foreground,background and alpha matte is proposed,and an automatic matting network combined with coarse semantics is designed.The algorithm method includes two stages:coarse semantics generation and matting via simultaneous foreground and background prediction.In the first stage,a semantic segmentation network is used to obtain intermediate results,and then a coarse semantic information fusion module is applied to roughly estimate the semantic information on multiple scales.In the second stage,an encoder-decoder is used to refine the semantic information and obtain the prediction of foreground,background and alpha matte.Foreground objects can be extracted more accurately through this two-stage network.Also,the obtained alpha matte can be directly used for downstream tasks such as image and video processing.The experimental results on Adobe dataset and the Distinction-646 dataset show that the sum of absolution difference is 42.5 and 50.3,the gradient error is 27.1 and 28.0,respectively.And the details are also more accurate.

     

/

返回文章
返回