基于注意力机制的高分辨率自动实时绿幕抠像方法
High Resolution Automatic Real-time Green Screen Keying Method Based on Attention Mechanism
-
摘要: 随着相机等硬件设备的更新换代以及观众审美水平的提升, 高分辨率下的绿幕抠像技术变得十分重要. 为实现高分辨率图像下精确且高效的绿幕抠像, 提出一种基于注意力机制的高分辨率自动实时绿幕抠像方法. 所提方法分为两个阶段, 第1阶段仅以RGB绿幕图像作为输入, 采用注意力机制来准确提取前景目标对象, 无需人工参与或生成近似背景图等预处理操作, 实现了自动化; 第2阶段增加深度引导滤波模块进行高分辨率处理, 实现了高分辨率下实时的处理效率. 在绿幕数据集上的实验结果表明, 所提方法在保证较好绿幕抠像精度的前提下, 达到2K分辨率视频下约80.2 帧/s的处理速度.Abstract: With the upgrading of hardware equipment such as cameras and the improvement of audience's aesthetic level, green screen keying technology under high resolution has become very important. In order to achieve accurate and efficient green screen keying in high resolution images, a high resolution automatic real-time green screen keying method based on attention mechanism is proposed. The proposed method is divided into two stages. In the first stage, only the RGB green screen image is used as input, and the attention mechanism is used to accurately extract the foreground object, without manual participation or the generation of approximate background image and other pre-processing operations, which realizes automation. In the second stage, the depth guided filter module is added for high resolution processing, and the real-time processing efficiency under high resolution is realized. The experimental results on the green screen data set show that the proposed method can achieve a processing speed of about 80.2 frames /s under 2K resolution video under the premise of ensuring good green screen keying accuracy.