高级检索

结构相似性引导的反走样神经网络

SSIM-Guided Neural Network for Anti-Aliasing

  • 摘要: 针对实时渲染中采样率不足导致的走样问题,以及传统反走样算法在处理着色走样和时域不稳定现象方面的局限性,提出一种结构相似性(SSIM)引导的反走样神经网络SGNN。该网络采用编码器-解码器架构,通过解耦器提取多尺度图像特征,将SSIM预测信息与图像重建信息进行分离;利用SSIM预测模块估计各像素区域的走样严重程度,并将预测结果作为先验信息指导核预测模块生成空间自适应的卷积核,实现高质量的邻域反走样;通过基于运动矢量和深度约束的时域累积器,结合特征重加权机制计算融合权重,将历史帧与当前帧加权融合,有效地抑制鬼影和闪烁等时域不稳定现象。在6个自建测试场景上的实验结果表明,与DLSS、MCNN和TAA这3种对比算法相比,所提网络的峰值信噪比平均值达到32.483 dB,较次优算法DLSS提升1.192 dB;SSIM平均值达到0.952,较DLSS提升0.017;IF-SSIM平均值达到0.994 8,优于DLSS的0.992 6,在反走样效果与时域稳定性方面均具有显著优势。

     

    Abstract: To address the aliasing problem caused by insufficient sampling rates in real-time rendering, as well as the limitations of traditional anti-aliasing algorithms in handling shading aliasing and temporal instability, an SSIM-guided anti-aliasing neural network called SGNN is proposed. The proposed network adopts an en-coder-decoder architecture: a decoupler extracts multi-scale image features, separating SSIM prediction in-formation from image reconstruction information; an SSIM prediction module estimates the aliasing severi-ty of each pixel region, and the prediction results serve as prior information to guide the kernel prediction module in generating spatially adaptive convolution kernels for high-quality neighborhood anti-aliasing; a temporal accumulator based on motion vectors and depth constraints, combined with a feature reweighting mechanism, computes fusion weights to blend historical and current frames, effectively suppressing tem-poral instability such as ghosting and flickering. Experimental results on six self-constructed test scenes demonstrate that, compared with three competing algorithms including DLSS, MCNN, and TAA, the pro-posed network achieves an average PSNR of 32.483 dB, surpassing the second-best algorithm DLSS by 1.192 dB; an average SSIM of 0.952, exceeding DLSS by 0.017; and an average IF-SSIM of 0.994 8, outper-forming DLSS at 0.992 6, demonstrating significant advantages in both anti-aliasing quality and temporal stability.

     

/

返回文章
返回