面向梯度域路径跟踪的时序网络重建方法
Temporal Reconstruction Network for Gradient-Domain Path Tracing
-
摘要: 针对现有的梯度域路径跟踪方法大多关注单帧的重建, 缺乏帧间信息的重用, 导致渲染结果帧间一致性难以保持的问题, 提出一种结合历史帧信息的梯度域网络重建方法. 该方法使用运动向量将历史帧信息映射到当前帧, 通过重建网络实现高质量的帧图像重建; 在重建网络中, 设计了基于时序信息的损失函数项, 从而在重建结果的空间可靠性和时间稳定性上实现平衡; 进而, 设计了重加权模块, 实现帧内重建的结果在帧间的合理传递, 在提升视觉质量的同时, 提升了时序连续性. 在Bedroom, Classroom, Bathroom等多个测试场景中进行实验的结果表明, 与主流的梯度域路径追踪网络重建方法GradNet相比, 所提方法均获得更高的单帧重建质量, 可在有效地消除噪声的同时保留更多的光照细节, 并且有效地消除了连续帧的闪烁问题, RelMSE降低14.28%~32.56%, LPIPS误差最多降低50.95%.Abstract: Aiming at the problem that most existing gradient domain path tracking methods focus on intra-frame reconstruction and lack the reuse of inter-frame information, resulting in difficulty in maintaining inter-frame consistency in rendering results, a gradient domain network reconstruction method combining historical frame information is proposed to address this issue. This method maps historical frame information to the current frame through motion vectors, and then achieves high-quality image reconstruction through the reconstruction network; In the reconstruction of the network, a loss function term based on temporal information was designed to achieve a balance between spatial reliability and temporal stability of the reconstruction results; Furthermore, a reweighting module was designed to achieve reasonable transmission of intra-frame reconstruction results between frames, improving both visual quality and temporal continuity. The experimental results show that compared with the mainstream gradient domain path tracking network reconstruction method GradNet, the proposed method achieves higher single frame reconstruction quality in multiple test scenes such as Bedroom, Classroom, and Bathroom. It can effectively eliminate noise while preserving more lighting details, and effectively eliminate the flicker problem of continuous frames. The RelMSE is reduced by 14.28% to ~32.56%, and the LPIPS error is reduced by up to 50.95%.
下载: